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The  Development  of  Guidance  Materials  for  Cadets  in  the  Selection 
of  Their  Area  of  Concentration 


ABSTRACT 


A guidance  program  and  techniques  to  assist  cadets  in  selecting  the 
area  of  concentration  most  compatible  with  their  profile  of  measured 
interests,  values  and  academic  capabilities  were  developed  on  the 
Class  of  1978  and  cross-validated  by  application  to  the  Class  of  1979. 

The  new  measures  of  compatibility  between  a cadet's  pattern  on  selected 
interests  and  values  and  the  pattern  of  cadets  typical  of  those  successful 
in  the  two  more  popular  areas  of  concentration  (the  Applied  Science 
and  Engineering  area  and  the  National  Security  and  Public  Affairs 
area)  had  high  validity  (respective  r's  = .71  and  .67)  , on  the  Class 
of  1978  from  which  a sample  was  used  to  develop  the  techniques  and 
high  cross  validity  on  the  Class  of  1979  (respective  r's  * .68  and 
.65) . Compatibility  scores  developed  for  both  the  Basic  Sciences  and 
Humanities  areas  were  based  on  samples  that  would  be  completely  inadequate 
in  size  if  the  traditional  techniques  were  used.  However,  their 
respective  validities  on  the  Class  of  1978  were  .68  and  . 64  and  their 
cross  validities  were  still  promising  ( . 34  and  . 31)  , but  indicated 
that  further  refinement  is  necessary. 

The  four  area  Predicted  Quality  Point  Averages  had  exceptionally  high 
validities  and  cross  validities  ranging  from  . 86  to  .93  for  the  Class 
of  1978  and  cross  validities  of  .79  to  .92  when  applied  to  the  Class 
of  1979. 

A Physical  Science  Areas/Non-Physical  Science  Areas  Score  (A,B/N,H) 
had  a correlation  of  .90  for  the  developmental  sample,  . 85  for  the 
total  Class  of  1978  and  . 83  for  the  Class  of  1979. 

Such  consistently  high  validities  indicate  high  potential  for  improving 
the  matching  of  a cadet's  special  characteristics  with  his  area  of 
concentration  and  increasing  his  satisfaction  and  success  at  West 
Point. 

A new  statistic  is  presented  that  indicates  the  reliability  of  differences 
between  scores  on  two  scales,  based  on  the  correlation  between  the  two 
and  on  their  two  reliability  coefficients. 

Further  developments  will  follow  trial  use  of  the  techniques  to  help 
guide  the  Class  of  1981  Cadets  in  choosing  their  area  of  academic 
concentration . 


DEVELOPMENT  OF  GUIDANCE  MATERIALS  FOR  CADETS  IN  THE 
SELECTION  OF  THEIR  AREA  OF  CONCENTRATION 


EXECUTIVE  SUMMARY 

A.  Purpose . To  develop  objective  guidance  measures  to  assist  cadets 
In  selecting  the  area  of  academic  concentration  most  compatible  with 
their  Interests  and  capabilities.  This  research  was  initiated  2 June 
1978  at  the  request  of  the  Office  of  the  Dean. 

B.  Methodology. 

1.  Statistical  techniques  were  developed:  (1)  to  measure  the  com- 
patibility of  (similarity  between)  a cadet's  pattern  of  interests  and 
values,  and  those  of  cadets  successful  in  each  area  of  concentration; 

(2)  to  predict  the  level  of  success  in  each  of  the  areas;  and  (3)  to 
provide  one  overall  measure,  combining  compatibility  scores  and  predicted 
success  scores  for  each  area  of  concentration,  to  assist  cadets  in 
deciding  between  a physical  science  area  (Basic  Science  and  Applied 
Science  areas)  and  a non-physical  science  area  (Humanities  and  National 
Security  fi  Public  Affairs  (NSPA) ) . The  next  three  paragraphs  address 
these  in  more  detail.  Data  on  the  Strong-Campbell  Interest  Inventory 
and  Rokeach  Value  Survey  tests,  and  grades  earned  in  secondary  school 
and  at  USMA  before  choosing  an  area  of  concentration  were  available  on 
the  cadets  who  graduated  in  the  Class  of  1978.  These  data  were  used  to 
develop  a special  scoring  technique  and  regression  equations  for  prediction 
of  each  of  the  three  criteria.  In  addition  to  construct  validity, 
evidence  on  cross-validity  was  obtained  by  applying  the  equations 
developed  on  the  Class  of  1978,  to  the  Class  of  1979  (as  of  December 
1978),  ard  comparing  predicted  results  with  actual  results. 

2.  For  each  cadet,  three  types  of  compatibility  scores  were 

developed  for  each  area  of  concentration  (see  left-hand  portion  of  Chart  1 
nample  report  to  academic  counselors,  pace  28).  The  twelve  scores 
indicate  the  degree  of  similarity  between  the  patterns  of  an  individual 
cadet  and  the  patterns  of  successful  cadets  (defined  as  those  cadets 
who  graduated  in  the  top  half  of  their  area  of  concentration)  in  their: 
General  Interests,  Occupational  Interests,  and  Values.  When  these 
twelve  scores  were  combined  with  optimal  weights  to  predict  membership 
in  a given  area  of  concentration  vs.  the  other  three  combined  at  gradu- 
ation in  the  Class  of  1978,  the  corrected*  multiple  correlation  of  the 
scores  with  membership  in  a given  area  are  . 71  for  Applied  Science,  .68 
for  Basic  Science,  . 67  for  National  Security  and  Public  Affairs,  and 
.64  for  Humanities.  fNote:  In  a multiple  correlation,  several  independent 
factors  (in  this  case,  the  twelve  scores)  are  weighted  in  terms  of 
their  combined  importance  as  a means  of  explaining  the  differences  in 
the  dependent  variable  (in  this  case,  graduation  in  an  area  of  concentration)) 
When  applied  to  the  Class  of  1979,  the  corresponding  cross-validity 
correlation  for  each  respective  area  was  . 68,  . 34 , . 65,  and  .31, 
indicating  high  continuing  validity  for  both  the  Applied  Science  and 
the  NSPA  areas  (that  had  the  larger  number  of  cases)  and  promising,  but 
relatively  low,  validity  for  the  other  two  areas. 


*Due  to  the  relatively  small  proportion  of  the  complete  data  sample  in 
areas  *B"  and  "H”,  the  obtained  correlations  for  these  two  areas  were 
underestimates  of  the  relationship  and  are  not  comparable  with  the 
others.  \ correction  factor  was  used  to  make  them  comparable  (explained 
in  the  body  of  the  report) . 
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3.  For  each  cadet,  a Predicted  Quality  Point  Average  (PQPA)  in 
each  area  of  concentration  was  developed.  Each  score  is  compared  to  a 
success  band,  indicating  the  probable  QPA  bands  among  cadets  with  his 
pattern  of  interests,  values  and  past  academic  achievement,  who  graduated 
in  each  area  of  concentration  (see  right-hand  aide  of  the  proposed 
Guidance  Report  to  Cadets) . The  correlations  between  predicted  area 
OPA  scores  and  actual  QPA,  by  area  of  concentration  in  the  Class  of 
1978,  and  the  cross-validities  found  when  applied  to  the  preliminary 
Class  of  1979  area  QPA‘s  near  the  end  of  the  seventh  term  (shown  in 
parentheses)  were  as  follows: 

a.  Applied  Science  .86  ( . 82) 

b.  Basic  Science  .93  (.92) 

c.  National  Security  and  Public  Affairs  .87  ( .88) 

d.  Humanities  .92  ( . 86) 


It  should  be  noted  that  although  the  correlations  are  high  for  both 
the  initial  sample  and  the  preliminary  validation  sample,  this  does 
not  mean  that  they  are  necessarily  well  suited  to  discriminate  among 
areas  of  concentration.  Unlike  the  compatibility  scores,  the  high 
intercorrelations  between  the  four  indicate  that,  in  general,  a cadet 
who  would  earn  a very  high  QPA  in  one  area  usually  would  earn  a high 
one  in  another  area. 

4.  The  Physical  Science/Non-Physical  Science  Score  results  from 
combining  the  cadet's  selected  compatibility  and  Predicted  Area  QPA 
standard  scores  into  one  regression  equation  that  most  accurately 
distinguishes  between  cadets  graduating  in  the  Physical  Science  areas 
(Applied  and  Basic  Science  areas)  and  those  graduating  in  the  other 
areas  (NSPA  and  Humanities) . The  corrected  correlation  between  the 
Physical  Science/Non-Physical  Science  Scores  and  membership  in  the 
Physical  Science  Group  or  the  Non-Physical  Science  group  was  ■ 90  for 
the  sample  on  which  developed,  and  .85  for  the  total  Class  of  1978. 
When  cross-validated  on  the  Class  of  1979,  the  correlation  was  . 83, 
still  remarkably  high. 

C.  RESULTS  AND  DISCUSSION. 

1.  An  end  product,  a proposed  "Area  of  Concentration  Selection 
Guidance  Report"  is  shown  as  Chart  1.  It  is  designed  for  distribution 
to  the  Academic  Counselors  to  help  them  in  counseling  cadets  in 
selecting  an  area  of  concentration.  Shown  as  Chart  2 is  a preliminary 
explanation  and  sample  simplified  summary,  prepared  by  the  Office  of 
the  Dean,  for  general  distribution  to  cadets  with  their  commercially 
produced  SCI I occupational  interest  profile. 

2.  The  scores  and  predictions  for  individual  cadets  are  based 
primarily  on  their  past  academic  performance,  so  any  appreciable 
changes  in  the  effectiveness  of  their  work-study  habits  will  effect 
the  accuracy  of  the  predictions  for  them. 

3.  The  differences  between  the  scales  for  the  Predicted  Area  QPA 
standard  scores  reflect  the  effects  of:  (1)  the  different  cadet 
courses  whose  grades  were  used  to  predict  cadet  success  in  each  area 
of  concentration:  (2)  any  differences  in  academic  ability  of  the 
cadets  enrolled  in  each  area:  and  (3)  any  differences  in  difficulty  of 
the  courses 
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4.  The  17  scores  to  ba  raportad  to  cadata  all  hava  very  high 
reliability  coeff icianta.  (The  Spearman-Brown  Prophesy  Formula 
yielded  eatimatea  of  .94  for  Rokeach  Value  baaed  area  compatibility 
acalea  and  .99  for  all  of  the  Strong-Campbell  Intereat  Inventory  baaed 

area  acalea.) 

5.  The  44  intercorrelationa  between  the  12  compatibility  atandard 
acorea  indicate  that,  altogether,  they  can  provide  uaeful  diacrimination 
between  the  areaa  (the  median  intercorrelation  ia  .32).  About  half  of 
theae  correlationa  are  poaitive  (indicating  a direct  mathematical 
relationahip) , and  half  have  negative  aigna  (indicating  an  inverae, 
mathematical  relationahip) . Theae  acorea  for  the  two  Phyaical 
Science  areaa  tend  to  have  negative  correlationa  with  acorea  for 

the  other  two  areaa,  and  vice  verea. 


4.  The  high  intercorrelationa  between  the  four  Predicted  QPA 
atandard  acorea  (.94  to  .97)  indicatea  that,  in  general,  a cadet  who 
would  earn  a relatively  high  (or  low)  area  QPA  in  one  area  would  alao 
earn  a relatively  high  (or  low)  area  QPA  in  the  other  areaa.  There 
are  uaeful  differencea  between  cadets'  Predicted  QPA' a for  the  aix 
area  pairinga,  but  development  of  more  diacriminating  functiona  may  be 
required.  However,  careful  guidance  ia  required  for  accurate  interpretation 
of  the  difference  between  the  current  PQPA'e  for  two  areaa. 


7.  Moat  of  the  weight  in  the  prodictiona  of  Area  QPA  goea  to  the 
cadet* a previous  academic  performance,  but  the  values  and  intereat 
measures  also  contributed  significantly  to  increased  accuracy  of 
predictions  in  all  except  the  Basic  Science  Area.  The  percent  of 


total  prediction  of 

actual  Area  QrA 

from  each 

measure  ia  as 

follows  1 

Area 

USNA 

Academic 

Performance 

H.S. 

Rank 

SCII 

Interest 

Rokeach 

Values 

Applied  Science 

71% 

3% 

14% 

12% 

Basic  Science 

88% 

10% 

- 

2% 

NSPA 

77% 

2% 

11% 

9% 

Humanities 

45% 

- 

21% 

14% 

8.  Although  the  individual  interest  and  values  compatibility  acalea 
do  not  now  have  a very  high  correlation  with  being  in  the  given  area 
group  (when  corrected  for  differences  between  the  proportions  of  the 
class  in  each  area,  the  correlation  coefficients  estimated  from  the  point- 
biserial  correlations  range  from  .29  to  .45,  with  a median  of  .54), 
each  relationahip  is  high  enough  to  provide  uaeful  guidance,  even  when 
considered  alone. 


9.  The  loss  of  cadeta  with  missing  data  on  any  variable  reduced 
the  number  of  cases  to  171  in  some  of  the  final  analyses.  Though  the 
descriptive  statistics  indicated  no  major  differences  between  the 
characteristics  of  the  reduced  samples  and  the  characteristics  of  the 
total  group  in  each  area,  the  smaller  number  remaining  in  the  Basic 
Sciences  and  the  Humanities  areaa  of  concentration  suggests  that  the 
predicted  Area  QPA  scores  for  theae  two  areas  are  likely  to  be  leas 
valid  than  will  the  predicted  Area  QPA* a for  Applied  Science  and  NSPA. 
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In  the  experimental  implementation  of  these  area  of  concentration 
guidance  materials,  in  April  1979  for  the  Class  of  1981,  the  area 
compatibility  scores  (Section  1 of  Charts  1 and  2)  were  reported  to  a 
sample  selected  as  the  experimental  group.  All  cadets  received  the  copy 
of  the  regular  Strong  Campbell  Interest  Inventory  Profile  (as  produced 
by  a commercial  scores  service)  from  their  company  academic  counselor. 
Thus,  the  new  program  was  introduced  using  only  the  portion  whose 
interpretation,  use,  and  technical  caveats  are  less  demanding  of  the 
counselors.  Host  of  the  company  academic  counselors  have  had  relatively 
little  professional  training  in  guidance  and  many  of  them  do  not  have 
a very  complete  understanding  of  statistical  regression  characteristics. 

Furthermore,  in  their  current  form  the  four  area  predicted  QPA's 
(PQPA's)  have  very  high  intercorrelations  which  when  coupled  with  the 
usual  tendency  of  "true"  scores  to  be  closer  to  the  mean  on  the 
criterion  variable  than  "predicted  scores"  (known  to  statisticians  as 
the  regression  tendency)  necessitates  careful  and  statistically 
sophisticated  guidance  and  accurate  interpretation  of  the  differences 
between  the  current  PQPA's  for  two  areas,  applying  the  explanations 
given  in  the  report. 

This  initial  developmental  process  was  designed  especially  to 
determine  if  useful  prediction  of  area  QPA's  could  be  obtained,  not 
to  maximise  the  differentiation  between  success  in  closely  similar 
areas.  Furthermore,  the  difference  between  the  Basic  Sciences  and 
Humanities  areas  and  the  number  of  cases  in  the  two  larger  areas  allowed 
differentiation  between  the  two  larger  areas  to  dominate  the  statistics. 

Until  area  PQPA's  could  be  made  more  differentiating  and  their 
effective  use  simplified,  it  seemed  best  to  omit  them  (Section  2 of 
Charts  1 and  2)  from  the  special  report  provided  to  the  cadets  in  the 
experimental  group.  Current  plans  envision  a follow-up  of  results 
in  the  Class  of  1981,  appropriate  refinement  of  the  developmental, 
reporting,  and  interpretation  procedures,  as  well  as  the  exploration 
of  the  possibility  of  guidance  materials  pointing  more  directly 
towards  special  academic  fields  or  small  clusters  of  closely  similar 
fields. 


10.  The  complexities  of  such  s now  guidance  program  may  cause  some 
difficulty  for  some  cadets,  even  with  the  best  written  explanations. 
Without  additional  general  group  guidance  and  any  desired  individual 
guidance,  the  current  system  may  be  subject  to  misinterpretation. 

11.  The  high  intercorrelations  between  the  four  area  Predicted 
QPA'a  (PQPA's),  coupled  with  such  characteristics  as  the  usual  tendency 
of  "true"  scores  to  be  closer  to  the  mean  on  the  criterion  variable  than 
are  "predicted  scores",  complicates  practical  interpretation  and  use  of 
the  differences  between  current  area  PQPA's. 


D.  CONCLUSIONS 


1.  The  results  may  be  used  by  cadets,  but  only  as  a guide,  since  their 
decision  on  area  of  concentration  should  include  any  other  relevant  con- 
siderations that  are  important  to  them  and  to  their  goals  in  life. 

2.  For  some  cadets,  these  measures  currently  will  not  provide  signifi- 
cant discrimination  between  the  areas  they  are  seriously  considering. 

3.  Although  application  to  the  Class  of  1979  data  available  near  the 
end  of  their  seventh  term  indicates  exceptionally  high  overall  validity, 
some  of  the  components  involved  in  the  compatibility  scores  need  to  be 
refined  and  sharpened  up.  Research  efforts  to  improve  the  techniques 
for  computing  and  using  the  scores  should  accompany  the  validation 
research  when  the  final  Class  of  1979  criterion  data  are  available. 

(This  class  took  the  SCII  in  September  1978) . 

4.  At  each  step  in  the  implementation  of  this  program  every  possible 
effort  should  be  made  to  identify  and  counteract  the  inherent  dangers  in 
such  a system,  such  as  a tendency  for  some  to  be  overly  dependent  on  it, 
lack  of  complete  accuracy  in  the  measures,  insufficient  discrimination, 
and  cadets  becoming  confused  by  the  many  complications,  and  considerations. 

E . RECOMMENDATIONS . 


1.  Administer  the  SCII  test  to  the  Class  of  1981}  compute  the  special 
area  scores}  and,  prior  to  selection  of  an  area  of  concentration,  give 
these  cadets  a simplified  computer-produced  summary  similar  to  Chart  2. 

2.  Provide  the  Company  Academic  Counselors  with  a more  refined  form, 
using  a computer-produced  format  along  the  lines  of  that  shown  in 

Chart  1. 


3.  Prior  to  the  report,  provide  the  Company  Academic  Counselors  with 
written  and  oral  explanations  of  the  basis,  meaning,  interpretation,  and 
use  of  the  results,  with  instructions  by  the  Office  of  the  Dean. 

4.  Obtain  feedback  from  the  cadets  to  assist  in  refining  the  system. 

5.  Evaluate  the  system  over  the  next  ten  months  to  determine  if  it 
is  in  fact  a useful  counseling  tool.  Incorporate  necessary  changes 

to  the  system  during  the  evaluation  to  account  for  changes  in  the 
characteristics  of  its  criterion  groups  and  improvements  in  the 
methodology. 

6.  Baaed  on  the  results  obtained  from  Recommendation  5,  decide  on 
whether  or  not  to  continue  the  system  with  the  Class  of  1982,  by 
October  1979. 
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THE  DEVELOPMENT  OF  GUIDANCE  MATERIALS 
FOR 

CADETS  IN  THE  SELECTION  OF  THEIR 
AREA  OF  CONCENTRATION 


L 


A.  PURPOSE 

1.  Near  the  middle  of  their  fourth  term  at  USMA  cadets  are  required 
to  select  an  area  of  concentration  for  their  remaining  academic  work, 
primarily  from  one  of  four  areas:  Basic  Science,  Applied  Science, 
Humanities,  and  National  Security  and  Public  Affairs.  Cadets  currently 
choose  their  area  of  concentration  without  the  benefit  of  objective 
quantifications  of  their  predicted  level  of  success  in  area  of  con- 
centration courses  or  of  their  possible  personal  satisfaction  in  each 
area. 


2.  On  2 June  1978,  The  Dean  of  the  Academic  Board  requested  that 
the  Office  of  Institutional  Research  utilize  the  data  available  on  the 
Class  of  1978  to  develop  techniques  for  providing  objective  guidance 
measures  to  the  cadets  in  their  selection  of  an  area  of  concentration. 

It  was  further  requested  that  the  measures  consider  cadet  potential  for 
compatibility  with  successful  performance  in  each  of  the  four  areas  of 
concentration.  This  report  presents  current  results  of  the  response  to 
the  Dean's  request. 

3.  In  this  research  program,  compatibility  is  defined  as  similarity 
between  a cadet's  pattern  (profile)  of  relevant  characteristics  and  the 
unique  pattern  of  measurable  characteristics  that  best  distinguishes 
cadets  successful  in  one  area  of  concentration  from  cadets  in  other 
areas. 


B.  METHODOLOGY 
1.  General 

a.  Data  available  on  computer  tape  records  for  the  cadets  in 
the  Class  of  1978  were  screened  to  select  the  objective  data  elements 
which  were  judged  to  be  most  likely  to  help  discriminate  aswang  successful 
cadets  in  the  four  areas  of  concentration.  Initial  variables  thus 
identified  included  measures  of  academic  success  in  high  school  (5 
variables)  and  during  early  terms  at  USMA  (28  courses) , admission  variables 
(CEER/ACEER) , measures  of  values  (ROKEACH  Value  Survey:  36  Value  Scales) 
and  of  interests  (Strong-Campbell  Interest  Inventory:  176  Interest 
Scales) . The  Strong-Campbell  Interest  Inventory  (SCII)  and  the  Rokeach 
Value  Survey  had  been  selected  previously  (because  of  their  preeminence 
as  practical,  researched,  and  psychometrically  sophisticated  measures  of 
an  individual's  patterns  in  various  types  of  interest  and  values),  and 
given  to  the  Class  of  1978  in  connection  with  two  other  research  projects. 
For  both  tests  extensive  comparative  data  are  available  to  enhance 
interpretation  of  the  results. 

b.  The  two  criteria  of  success  used  in  this  study  were  (1'  cadet 
compatibility  of  interests  and  value  patterns  with  these  patterns  of 
cadets  with  area  QPA's  in  the  top  half  for  their  area  of  concentration, 
and  (2)  area  of  concentration  Quality  Point  Average  (area  QPA) . 
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c.  A group  of  64  "trial"  variables  (computed  composite  scores) 
were  developed  from  the  262  original  exploratory  variables  as  potential 
predictors  of  success  in  an  area  of  concentration.  Two  types  of  computed 
scores  - one  to  predict  the  cadet's  compatibility  with  an  area  of  con- 
centration and  the  other  to  predict  the  cadet's  area  of  concentration 
QPA  - were  developed  from  the  original  variables  as  follows: 

(1)  For  each  of  the  262  original  variables  previously  mentioned, 
the  statistical  significance  was  determined  (F-tests  and  t-tests)  for 
the  difference  between  the  means  of  the  following  groups:  (a)  cadets 

in  each  area  of  concentration  versus  those  in  all  the  other  areas  combined; 
(b)  cadets  in  the  top  half  versus  those  in  the  bottom  half  of  a given 
area  of  concentration;  (c)  a composite  of  all  cadets  in  the  top  half 
of  their  area  versus  a composite  of  all  those  in  the  bottom  half  of 
their  area  of  concentration;  (d)  cadets  in  one  of  the  two  physical 
science  areas  (Basic  and  Applied  combined)  versus  those  in  one  of  the 
non-physical  science  areas  (NSPA  and  Humanities  combined) . In  addition, 
two  sets  of  correlations  were  computed  for  each  initial  variable,  one 
set  with  membership/nonmembership  in  each  area  (point  biserial  correlations) 
and  the  other  set  with  area  QPA  (regular  product-moment  correlations) . 

The  statistical  significance  of  each  of  the  524  correlation  coefficients 
was  produced  also  by  the  SPSS  computer  program. 

(2)  The  original  variables  with  high  statistical  significance  (usually 
p<.001)  as  predictors  of  group  membership  or  of  area  QPA  were  selected 
for  inclusion  in  one  of  the  64  preleminary  scales.  (APPENDIXES  I through 
IV  identify  these  variables  and  present  relevant  statistics.)  Using  a 
unique  approach,  each  selected  variable's  correlation  with  the  criterion 
was  converted  to  an  equal-unit  interval  scale  and  the  resulting  "weight" 
was  given  the  sign  of  the  correlation  coefficient.  (The  correlation  to 
weight  transformation  table  is  given  in  Appendix  VII.)  For  each  cadet, 
his  original  score  on  that  initial  variable  was  multiplied  by  this 
weight,  and  the  products  for  each  type  of  variable  added  to  produce  the 
64  computed  trial  scores  for  each  cadet.  Thus  a set  of  four  area-of- 
concentration  group  membership  computed  scores  and  four  area  QPA  computed 
scores  were  produced  from  each  of  the  eight  types  of  potential  predictor 
measures.  These  measures  included  Strong-Campbell  Interest  Inventory, 
Rokeach  Value  Survey,  High  School  academic  performance,  Admissions  Tests 
(one  from  CEER  component  tests  and  one  from  ACEER  tests)  and  early  USMA 
performance  (from  28  course  grades  and  nine  averages  for  departmental 
groups  of  courses) . 

d.  In  brief,  three  types  of  scores  have  been  developed  for  the 
guidance  of  cadets: 

— scores  to  measure  a cadet's  compatibility  with  cadets  successful 
(above  average)  in  each  area. 

— scores  to  predict  a cadet's  QPA  in  each  area. 

— composite  score  combining  the  other  two  types. 

2.  Cadet  Compatibility  with  Areas  of  Concentration 

a.  Area  Compatibility  Raw  Scores.  Three  sets  of  raw  scores  were 
developed  as  predictors  of  cadet  compatibility  with  each  of  the  four 
areas  of  concentration: 

— general  interest  scores 
— occupational  interest  scores 
— Rokeach  value  scores 
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U)  G«n«r»l  Interest  Based  Compatibility  Raw  Scores.  General 
interest  scores'  (GI  raw  scores)  were  computed  from  the  cadet's  scores  on 
these  regular  Strong-Campbell  Interest  Inventory  (SCI!)  Scales  that 
reflect  his  responses  to  the  questions  on  six  Themes  (such  as  Realistic, 
Investigative,  Social)  and  in  23  Basic  Interest  (BI)  scales  (such  as 
Military  Activities,  Mathematics,  Nature).  They  also  included  the  SC11 
scales  for  "Academic  Orientation",  "Occupational  Introversion",  and  for 
tendency  to  give  "like",  "undecided-indifferent,"  or  "dislike*  responses 
to  seven  types  of  questions  (as  on  occupations,  activities,  school 
subjects,  or  types  of  people).  For  example,  the  Applied  Science  Area 
General  Interest  raw  score  (AS  GI  RSC)  is  the  sum  of  the  cadet's  score 
multiplied  by  the  equal-unit  transformation  (as  shown  in  Appendix  VII) 
of  the  correlations  shown  in  Appendix  I." 

(2)  Occupational  Interest  Based  Compatibility  Raw  Scores.  These 
sets  of  "01 ^ raw  scores  were  similarly  computed  by  weighting  the  scores 
made  by  each  cadet  on  the  selected  scales  from  the  124  Strong  Campbell 
Interest  Inventory  occupational  scales.  (The  selected  scales  and  cor- 
relations are  shown  in  Appendix  II.) 

(3)  Rokeach  Value  Based  Compatibility  Raw  Scores.  The  four  area 
"RV"  raw  scores  were  developed  from  the  caaet's  scores  for  each  of  the 
Rokeach  Valuos  identified  in  Appendix  III,  in  the  same  way  as  were  the 
area  compatibility  interest  scores  as  described  above. 

b.  Area  Compatibility  Standard  Scores.  The  three  sets  of  raw 
compatibility  scores  for  each  area  were  converted  to  a standard  score 
with  a mean  of  50  and  standard  deviation  of  10  for  all  cadets  in  the 
sample  who  graduated  in  the  top  half  of  their  area  of  concentration. 

(Cadets  who  graduated  in  the  top  half  of  all  cadets  in  the  given  area  of 
concentration  are  defined  as  "successful").  The  magnitude  of  each 
cadet's  scores  in  the  three  measurement  areas  (general  interest,  occupation 
interest  and  Rokeach  value  scores)  reflect  the  similarity  of  that  cadet's 
values  and  interests  compared  to  cadets  of  the  Class  of  1978  who  were 
successful  (top  half)  in  a given  area  of  concentration. 

c.  Discriminant  Analysis.  In  order  to  investigate  the  effectiveness 
of  using  the  three  standardised  scores  to  classify  cadets  into  areas  of 
concentration,  a discriminant  analysis  was  performed.  If  cadets  were 
reassigned  to  the  four  areas  of  concentration  by  chance  alone,  on  the 
average  about  25%  normally  would  be  correctly  assigned.  The  discriminant 
analysis  correctly  assigned  50%  of  the  cadets  in  the  four  highhalf  Area 
OPA  groups  when  Rokeach  value-based  area  standard  were  used,  69%  when 
only  the  four  area  General  Interest  Scores  were  used,  and  65%  when  only 
the  four  Occupational  Interest  Scores  were  used.  For  both  the  Applied 
Science  and  NSPA  areas  80%  were  correctly  assigned  by  both  seta  of 


"Specifically,  AS  GI  Raw  Score  - 10  (Mechanical  Activities  BI  Score)  ♦ 

09  (Mathematics  BI  Score)  ♦ 08  (Realistic  Theme  Score  + Science  BI 
Score)  + 06  (Introversion  Special  Scale)  ♦ 05  (Investigative  Theme 
Score)  v 04  (Conventional  Theme  Score)  + 02  (Characteristics  "7"  Response 
% Score)  -02  (Characteristics  "Yes*  Response  % Score)  -03  (Social  Theme 
Score  Teaching  BI  Score  * Right  Preference  Response  % Score)  -04 
(Artistic  Theme  Score  ♦ Music/Dramatics  BI  Score)  -05  (Social  Service  BI 
Score)  -06  (Writing  BI  Score  ♦ Public  Speaking  BI  Score  ♦ Law/Politics 
BI  Score) . 
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scores  from  SCII.  The  four  ares  Rokeach  Value  set  correctly  classified 
50%  of  the  Applied  Science  group  and  72%  of  the  NSPA  group  (see  Appendix 
VIII  which  explains  the  results  of  the  discriminant  analysis). 

d.  Regression  Analysis.  The  collective  effectiveness  of  the 
twelve  area  compatibility  scores  (in  correctly  matching  cadets  with 
their  area  of  concentration)  was  checked  further  by  developing  multiple 
regression  equations.  Each  such  equation  determines  and  uses  the  weighted 
pattern  on  an  optimal  selection  from  the  twelve  area  compatibility 
standard  scores  to  predict  being  in  a given  area,  versus  all  other  areas 
combined,  at  graduation.  The  multiple  correlations  produced  are  point- 
biserial  correlations,  with  maximums  possible  ranging  from  .20  to  .80, 
depending  on  the  preparation  of  the  total  group  that  is  in  the  area 
involved.  Hence,  they  were  corrected  to  a comparable  1.00  maximum  by 
dividing  the  obtained  r by  the  corresponding  maximum  possible  point- 
biserial  r for  that  area.  The  multiple  regression  equations  were  also 
applied  to  the  Class  of  1979  to  check  their  cross  validities. 

Regression  equations  with  membership  in  an  area  as  the  dependent 
variable  and  only  the  three  compatibility  standard  scores  for  that  area 
as  independent  variables  were  not  used  as  they  could  not  be  as  effective 
in  discriminating  between  the  more  similar  areas  (area  "A"  vs.  area  "B'1 
or  area  "N"  vs.  area  *H")  as  could  the  significantly  discriminating 
patterns  from  all  twelve  area  compatibility  scores.  For  example,  some 
of  the  humanities  compatibility  scores  aided  markedly  in  discriminating 
cadets  in  the  Applied  Sciences  and  Engineering  Area  from  those  in  the 
Basic  Sciences  area. 

It  was  judged  desirable  to  provide  the  cadet  with  a less  complex 
basis  for  interpreting  the  twelve  compatibility  scores  and  their  combinations 
into  a general  indisation  of  this  overall  relationship  between  his 
compatibilities  and  the  four  areas  of  concentration.  Hence  the  four 
Rokeach  Value  based  compatibility  standard  scores  (RVSS's)  were  ranked 
from  high  to  lowi  the  four  area  GISS's  were  similarly  ranked)  and  the 
four  area  OISS's  likewise.  The  three  resulting  ranks  for  each  area  were 
averaged  and  the  three  corresponding  area  compatibility  standard  scores 
were  averaged  also  (see  Chart  1) . 

The  four  areas  were  then  ranked  in  terms  of  their  mean  ranks 
(ties  between  areas  were  broken  by  the  ranks  of  the  corresponding 
standard  score  means).  Thus,  each  of  the  twelve  compatibility  scores 
were  given  equal  weight  in  identifying  the  area  in  which  a cadet's 
pattern  of  values  and  interests  is  most  discriminatingly  like  the  patterns 
of  successful  cadets  at  graduation.  The  ranks  of  these  four  area  means 
were  used  to  develop  Section  1 of  the  simplified  summary  report  to 
cadets  (see  Chart  2) . 

3.  Predicted  Area  of  Concentration  Quality  Point  Average  (Area  PQPA) 

a.  Area  PQPA  Raw  Scores.  Using  the  equal-interval  scale  technique 
mentioned  previously,  for  weighting  in  terms  of  correlations  with  the 
criterion,  four  sets  of  raw  scores  were  developed  for  each  cadet  as 
independent  predictors  of  his  4-year  a; ea  quality  point  average  if  he 
were  to  select  one  of  the  possible  arr of  concentration: 

— a combination  of  general  interest  and  occupational 
interest  scores 

— early  academic  performance  at  USMA 

— Rokeach  Value  Survey  Score 

— High  school  rank 
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(1)  General  Interiit-  Occupational  Interest  Scores.  When  QPA  in 

an  area  was  used  as  the  criterion,  these  two  types  of  scores  (see  paragraph 
2 above  for  description)  were  combined  (averaged) . The  correlations 
between  the  two  for  a given  area  were  too  high  for  both  to  contribute 
effectively  in  a regression  equation,  even  though  they  represent  different 
hinds  of  interest  scales  (see  Appendix  I and  Appendix  IX) . 

(2)  Early  Academic  Performance  at  USMA.  A measure  of  future 
academic  success  at  USkX  for  each  caclet  was  developed  based  on  his 
grades  in  courses  regularly  completed  as  of  the  end  of  first  term,  third 
class  yeart  mathematics,  physical  sciences,  foreign  languages,  English, 
social  sciences  and  history.  In  most  departments  cadets  may  be  assigned 
to,  or  select,  different  courses  (as  in  English,  Mathematics,  Foreign 
Languages,  and  History),  hence  the  cadet's  departmental  averages  on  the 
courses  taken  were  used. 

(a)  Raw  scores  for  academic  performance  in  each  area  of  concentration 
were  computed  by  assigning  weights,  using  the  equal- interval  transformation 
shown  in  Appendix  VII,  to  grades  received  based  on  the  correlation  of 

the  grades  with  area  of  concentration  grade  point  average. 

(b)  Using  the  weights  thus  determined,  a similar  equation  was 
developed  to  predict  the  quality  point  average  of  oach  cadet  in  each  of 
the  four  areas  of  concentration  from  his  early  USMA  academic  success 
(see  Appendix  IV) . 

(3)  Rokeach  Value  Scores.  These  were  developed  in  a manner  similar 
to  that  for  computation  of  raw  scores  described  in  paragraph  2a  (3) , but 
using  QPA  in  an  area  as  the  criterion.  (See  Appendix  III  for  the  values 
significantly  related  to  area  QPA  and  Appendix  IX  for  inter  correlations 
of  area  value  scores.) 

(4)  High  School  Rank  Score.  A standardised  score  of  high  school 
rank  (computed  For  each  cadet  while  a candidate  for  USMA)  was  included 
since  previous  research  indicated  that  performance  in  high  school  correlates 
well  with  final  class  standing  at  graduation  from  West  Point.  Appendix 

V summarises  the  data  for  the  pre-USMA  performance  variables,  including 
some  not  used  at  this  time  because  they  were  readily  available  for  only 
a relatively  few  cadets. 

b.  Area  PQPA  Regression  Equations. 

(1)  The  General/Occupational  Interest  Scores,  Academic  Performance 
Scores,  Rokeach  Value  Scores,  and  High  School  Rank  Scores  were  combined 
into  four  regression  equations  that  yielded  the  most  accurate  prediction 
of  quality  point  average  for  each  of  the  four  areas  of  concentration. 

(2)  For  each  cadet,  the  four  regression  equations  were  used  to 
compute  a predicted  QPA  for  each  of  the  areas  of  concentration.  Thus, 
each  cadet  can  be  given  both  an  expected  Area  QPA  and  a standard  score 
that  can  be  readily  interpreted  in  terms  of  area  percentiles  based 
either  on  all  cadets  graduating  in  the  given  area  in  1978  or  only  on 
those  with  the  same  PQPA.  These  will  permit  direct  comparisons  of  level 
of  performance  in  the  future  with  predicted  performance.  (Table  6 shows 
Predicted  QPA's,  multiplied  by  100,  and  percentiles  for  each  area). 

(3)  To  reduce  a tendency  to  treat  the  predicted  QPA's  as  having 
perfect  precision  and  to  insure  that  random  errors  of  estimate  (prediction 
errors),  are  considered  by  cadets,  confidence  bands  were  computed  for 
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each  of  the  QPA  predicted  standard  scores.  The  probable  error  of  estimate 
was  computed  for  each  of  the  scores  to  provide  the  basic  confidence 
band.  For  the  predicted  score,  the  predicted  score  plus  one  probable 
error  of  estimate,  and  the  predicted  score  minus  one  probable  error  of 
estimate  the  expected  percentile  rank  equivalents  (among  all  cadets 
graduating  in  that  area)  were  computed  for  use  by  the  academic  counselors 
to  help  guide  the  cadet.  (See  Appendix  VI  B to  VI  E for  the  basic  data. 
Table  6 for  generalised  statistics,  and  charts  1 and  2 for  example 
reports  to  cadets  and  to  academic  counselors.) 


(4)  Comparison  of  Earned  QPA  With  Predicted  QPA*.  For  each  area 
of  concentration,  four  graphs  were  produced  depicting  the  correlation 
between  actual  area  QPA  and  the  four  predicted  area  QPA  standard  scores. 
These  graphs  show  the  observed  distribution  of  differences  between 
actual  QPA  and  predicted  QPA  for  cadets  of  the  Class  of  1978  (see  Table 
6) . The  correlations  between  Area  QPA  and  Predicted  Area  QPA  and  their 
probable  errors  of  estimate,  in  QPA  points,  were  as  follows: 


Applied  Sciences  and  Engineering  r».860, 
Basic  Sciences,  r».933,  PEEST  *.118 
National  Security  and  Public  Affairs,  r* 
Humanities,  r-.916,  PEEST  - .116 


PEEST 

.866, 


*.187 


PE 


EST 


.178 


4.  Composite  Measures  of  Similarity  Between  Each  Cadet  and  Cadets 
Graduating  in  Each  Area  of  Concentration. 


One  of  the  two  types  of  standard  scores  previously  discussed,  (the 
Compatibility  Scores)  reflects  the  extent  to  which  a cadet's  patterns  on 
significantly  discriminating  general  and  occupational  interests  and  the 
significant  components  of  his  value  system  are  similar  to  those  of  above 
average  cadets  in  each  area.  The  other  type  (predicted  Area  QPA's) 
provides  him  with  predictions  of  his  level  of  success  in  each  of  the 
areas  if  he  performs  in  the  future  as  he  has  in  the  past.  Where  the 
higher  scores  on  the  three  compatibility  scales  and  PQPA  scale  all  tend 
to  be  in  the  same  area,  the  cadet  should  have  no  problem  integrating 
these  with  any  other  considerations  that  he  might  consider  important  in 
light  of  his  individual  goals.  However,  when  the  four  higher  scores  do 
not  tend  to  be  predominantly  in  the  same  area,  the  cadet's  task  becomes 
more  complex. 


The  major  decision  for  many  cadets  seems  likely  to  be  whether  to  go 
into  one  of  the  Physical  Science  areas,  or  into  one  of  the  other  areas. 
The  patterns  of  intercorrelations  between  the  typical  interests,  values, 
and  special  cognitive  abilities  of  cadets,  their  entry  into  discriminant 
functions  (see  Appendix  VIII) , and  related  research  on  curricular  dimen- 
sions at  other  colleges  (Biglan,  1973;  Kuhn  1962;  Smart,  et  al,  1977) , 
all  suggest  that  the  major  dimension,  or  factor,  distinguishing  between 
the  four  areas  of  concentration  may  appropriately  be  called  a Physical 
Science-Non  Physical  Science  dimension,  with  NS  PA  and  Humanities  at  the 
opposite  end  of  the  scale  from  the  Applied  Science  and  Basic  Science 
areas*.  Membership  in  the  two  area  groups  was  used  as  the  criterion 


"Comparisons  of  area  PQPA's  with  each  other  are  included  in  the  sections 
on  Reliability  of  Differences. 

*A  definitely  secondary  dimension  seems  to  be  "Pure  Science"  - "Applied 
Science",  with  Humanities  and  Basic  Science  areas  at  one  end  and  Applied 
Science  and  NSPA  areas  at  the  other,  but  this  dimension  (factor)  was 
less  distinct  and  accounted  for  a relatively  small  portion  of  the  variance. 


variable,  a regression  equation  developed,  and  raw  acores  converted  into 
scaled  scores.  A low  score  indicates  similarity  to  cadets  in  the  A/B 
areas,  a high  score  indicates  similarity  to  cadets  in  the  N/H  areas,  and 
a score  of  about  50  indicates  lack  of  an  overall  composite  tendency 
toward  either  group  of  areas. 

»» 

This  score  is  a statistical  combination  of  the  compatibility  and 
area  PQPA  scores  into  a composite  total  score  that  optimizes  each 
component's  weight  to  maximally  represent  the  degree  of  similarity 
between  the  cadet's  patterns  of  relevant  characteristics  and  the  patterns 
of  these  characteristics  of  cadets  who  graduate  in  the  two  criterion 
groups  (A/B  or  N/H  areas) . Multiple  regression  equations  accomplished 
this  purpose.  They  combine  the  cadets  sets  of  twelve  compatibility 
scores  (area  values  and  interest  standard  scores)  and  predicted  area  QPA 
standard  scores,  with  each  weighted  in  such  a way  as  to  predict  similarity 
with  cadets  graduating  in  the  A/B  versus  the  N/H  areas  with  maximum 
accuracy  possible  from  these  variables. 

This  composite  score  is  particularly  important  initially,  as  the 
number  of  cases  remaining  in  the  Humanities  and  Basic  Science  Areas  had 
shrunk  so  much  that  little  confidence  could  be  felt  in  the  results  if 
they  were  used  for  guidance  purposes  in  these  two  areas  until  they  were 
cross  validated.  Fortunately,  the  regular  profile  provided  commercially 
for  the  SCII  contains  much  of  the  additional  guidance  information 
likely  to  be  needed  by  cadets  seriously  considering  selection  of  either 
the  Basic  Sciences  or  Humanities  area. 

The  distribution  statistics  on  all  the  final  standard  scores  were 
computed  for  the  cadets  in  each  of  the  four  area  groups  and  for  those  in 
each  Area  QPA  upperhalf/lowerhalf  sub  groups.  These  are  given  in 
Appendix  VI. 

5.  Reliability  of  Scores  and  of  Differences. 

a.  Reliability  Coefficients.  Reliability  coefficients  for 
the  36  individual  values  and  for  the  various  interest  scales  are  given 
respectively  in  the  manuals  for  the  Rokeach  Values  Survey  (Rokeach  1973) 
and  for  the  Strong-Campbell  Interest  Inventory  (Campbell,  1977).  The 
reliability  of  term-end  grades  earned  in  typical  USMA  academic  courses 
in  1968-1971  have  been  previously  reported  to  be  .54  (Bridges  1974). 

The  reliabilities  reported  for  the  scales  used  from  each  type  of  test 
were  sufficiently  homogeneous  that  the  median  reported  reliability 
coefficient  and  the  number  of  interest,  or  value,  scales  could  be  used 
in  the  Spearman-Brown  Formula  (Downie,  1977,  p.257)  to  obtain  useful 
estimates  of  the  reliabilities  of  the  final  sets  of  seventeen  scores 
reported  for  cadets.  Since  each  of  the  individual  scales,  that  were 
combined  to  compute  the  area  scores  from  the  two  standardized  tests, 
already  had  useful  reliability  as  reported  in  their  manuals,  their 
combination  into  computed  USMA  scores  yields  very  accurate  measures  as 
shown  in  Table  1. 


b.  Probable  Error  of  Measurement  of  Score.  When  inter- 
preting an  obtained  score  a useful  measure  of  its  accuracy  is  the  band 
obtained  by  adding  to  it  and  subtracting  from  it  the  Probable  Error  of 
Measurement  for  that  scale  as  shown  in  Table  1 (PEM  » .6745  SD  /l-r¥¥) . 
This  band  identifies  the  range  within  whir**  an  individual's  "true*  score 


on  the  measure  can  be  expected  to  fall  5C  » the  time,  below  which  25% 
and  above  which  25%.  In  other  words,  one  be  reasonably  confident 
that  an  individual's  "true"  score  falls  within  this  band,  but  there  is 
one  chance  in  four  that  the  cadet's  true  ability  is  below  this  band  and 
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one  chance  in  four  that  it  ia  above  this  band.  For  higher  confidence, 
doubling  the  PEmaas  * band  expected  to  include  the  true  score 

more  than  nine  times  in  eleven,  the  true  score  being  above  the  band  less 
than  one  time  in  eleven  (p*.0885).  PEM  g multiplied  by  2.439  can  be 
used  to  obtain  the  90%  band,  with  only”?  chance  in  20  of  true  score 
being  higher.  The  use  of  such  bands  for  reporting  scores  is  widely 
preferred  because  it  emphasizes  the  point  that  no  measure  or  prediction 
is  absolutely  precise  and  because  it  meaningfully  depicts  the  level  of 
accuracy  when  interpreting  a specific  score. 


c.  The  Reliability  of  Differences  Between  Two  Scores.  For 
a difference  between  scores  on  two  scales,  there  are  two  influences  on 
the  magnitude  of  its  reliability:  errors  due  to  the  unreliability  of 
the  two  scales  and  the  correlation  between  the  two  scales.  When  two 
scores  have  a correlation  of  zero,  the  amount  of  overlap  between  the 
probable  error  of  measurement  bands  for  the  two,  as  discussed  above,  can 
provide  an  accurate  indication  of  the  amount  of  confidence  that  the 
cadet's  true  scores  differ.  If  the  two  confidence  bands  for  uncorrelated 
scales  overlap  more  than  50%,  the  corresponding  true  measures  on  the  two 
scales  are  more  likely  to  be  the  same  than  to  be  different.  However 
most  of  the  measures  have  at  least  a low  correlation.  The  higher  the 
correlation  between  the  two  measures  involved,  the  greater  the  overlap 
in  the  two  bands  can  be  (i.e.,  the  less  the  difference  between  the  two 
scores)  and  still  represent  true  differences  between  the  two  abilities 
of  the  cadet. 


1 - (SD^error/SD2  ) 


— the  characteristics  of  the  method  by  which  they  were 
constructed 

— their  relationships  with  the  criteria  in  the  Class  of 
1978 

— their  relationships  with  the  preliminary  criteria  when 
computed  for  the  Class  of  1979 

(a)  Characteristics  of  the  Construction  Method.  Each  of  64 
preliminary  scores  were  developed  by  a significant  refinement  of  the 
method  that  Dr.  Strong,  Dr.  Campbell  and  other  researchers  have  so 
repeatedly  in  the  last  90  years  shown  can  yield  scales  that  are  unique 
in  their  success  in  validly  discriminating  between  criterion  groups.  To 
interpret  the  refinements  necessary  in  this  research,  it  is  necessary  to 
have  a general  idea  of  the  usual  method.  It  identifies  the  individual 
items  for  which  responses  by  individuals  in  the  two  groups  characteristically 
differ  markedly.  The  responses  to  these  items  are  weighted  in  accordance 

to  the  way  their  responses  differ  correspondingly  (now  usually  ♦ 1,  0, 
or  -1)  and  the  weights  added  to  obtain  a raw  score  scale.  This  is 
converted  to  a standard  score  scale,  usually  one  with  a mean  of  90  and  a 
standard  deviation  of  10  in  the  significant  criterion  groups.  The  very 
low  reliability  usual  for  individual  items  requires  large  groups  (prefer- 
ably more  than  300  individuals  in  the  criterion  group  and  many  more  in 
the  reference  group),  forty  to  fifty  discriminating  items,  and  differences 
of  18%  or  more  in  the  keyed  responses  of  the  criterion  group  and  the 
reference  group.  Campbell  states,  "...scales  of  this  length  have  good 
test-retest  reliabilities,  and  items  showing  this  difference. . .provide 
valid  scales  that  are  unusually  lcsistant  to  cross-validation  shrinkage! 
that  is  when  applied  to  new  samples,  their  ability  to  discriminate 
persists."  (Campbell,  1977,  p.  50.) 

The  64  preliminary  scales  (32  area  of  concentration  membership 
scales  and  32  area  of  concentration  QPA  scales)  were  developed  by  using 
regular  test  scores  yielded  by  the  test  author's  scoring  procedure  (each 
of  which  have  acceptable  reliability)  instead  of  from  one  small  group  of 
individual  items.  Their  unique  weighting  in  terms  of  their  validity  and 
addition  into  one  raw  score  avoids  the  multi-colinearity  problem  and 
reduced  reliability  when  multiple  regression  techniques  were  used  directly 
on  the  individual  teat  scales,  USMA  course  grades,  or  high  school  perform- 
ances. Thus  useful  validity  and  reliability  both  are  expected  with 
even  a relatively  small  number  of  scales  and  individuals.  In  fact  the 
major  reason  for  dropping  those  preliminary  scales  eliminated  (some  were 
combined  for  reasons  of  parsimony  and  colinearity)  was  because  of  current 
lack  of  ready  availability  for  all  cadets  rather  than  lack  of  validity. 

(This  was  especially  true  of  average  high  school  grades  in  the  major 
high  school  departments,  and  of  CEER  and  ACKER  components.)  There  seems 
to  be  clear  evidence  on  construct  validity. 

(b)  The  Relationship  of  the  Scores  with  the  Criteria  in  the 
Class  of  1978.  Only  complete  data  cases  were  used  in  the  successive 
developmental  analyses,  so  the  initial  733  cadets  had  shrunk  to  171 
c**«»  for  the  final  developmental  sample.  In  the  developmental  samples 
the  magnitude  and  significance  of  the  correlations  and  with  the  criteria 
(see  Table  9)  and  of  the  differences  between  distributions  of  scores  for 
the  relevant  groups  (see  Appendix  6A-6Q)  provide  clear  evidence  on  the 
concurrent  validity  of  each  of  the  scales,  when  requisite  data  were 
available  so  that  the  scores  could  be  computed  for  a much  greater  number 
in  the  Class  of  1978,  minor  shrinkage  in  the  correlations  with  the 
criteria  provides  additional  suggestions  of  the  persistence  of  the 
validity  in  other  groups. 


(c)  The  Relationship!  Between  the  Scores  and  the  Preliminary 
Criteria  When  Computed  for  the  Class  of  1979.  The  equations  developed 
on  samples  from  the  Class  of  1978  for  the  17  scores  used  in  the  area  of 
concentration  guidance  program  were  applied  to  the  cadets  in  the  Class 
of  1979.  Most  of  them  had  taken  the  Strong-Campbell  Interest  Inventory 
in  1978  and  the  Rokeach  Values  Survey  in  1977  (both  during  reorganisation 
week  for  other  research  projects).  In  computing  their  preliminary  area 
QPA's,  only  those  grades  on  record  in  December  1978  could  be  used. 
However,  their  final  grades  in  1978-79  could  hardly  produce  significant 
changes  in  the  correlations  between  area  Predicted  QPA  scores  and  earned 
Area  QPA's.  These  correlations  of  the  area  scores  with  the  criteria  are 
shown  in  Table  7,  accompanied  by  discussion  of  their  implications. 


C.  RESULTS  AND  DISCUSSION 


The  development  of  the  materials  for  this  educational  guidance 
program  involved  so  many  steps  and  intricate  evaluations  that  soate  key 
findings  were  incorporated  with  the  above  detailed  sequential  presentation 
of  the  procedure  in  order  to  facilitate  efficient  communication  and 
understanding  of  the  methodology  and  results.  The  basic  supporting 
statistical  details  are  presented  in  the  appendixes. 

Those  statistical  results  and  considerations  considered  to  be  most 
crucial  to  understanding  and  using  the  materials  for  this  program  are 
presented  in  the  following  tables  and  charts  and  their  accoaq>any  ing 
discussions. 

1.  Reliability  of  Area  Scores. 

Every  measurement  can  be  considered  as  consisting  of  two  components, 
due  to  errors  of  measurement.  The  other  component  is  the  "true"  measure 
component. 

The  smaller  the  proportion  of  the  obtained  measures  that  is  solely 
due  to  errors  of  measurement,  the  higher  the  proportion  solely  reflecting 
the  "true"  measure. 

Hence,  the  reliability  is  sometimes  refused  to  as  precision,  or 
accuracy  and  consistency  or  reproducibility.  Both  high  reliability  and 
high  validity  are  required  for  high  dependability.  The  reliability  of  a 
test,  scale  or  other  instrument  is  defined  as  that  portion  of  the  total 
obtained  variance  of  the  scores  that  is  due  to,  or  results  from,  variance 
in  the  "true"  scores  on  the  characteristic  being  measured  for  the  group 
being  measured.  Reliability  of  a test  or  scale  is  most  commonly  measured 
by  some  version  of  self-correlation  (self-consistency)  of  scores  from 
two  administrations  of  the  test  or  scale.  Reliability  of  an  individual 
score  is  commonly  indicated  by  the  number  of  score  units  from  (above 
or  below)  the  obtained  score  that  one  can  be  confident  (at  a specified 
level)  will  include  the  "true"  score.  Score  precision  can  be  indicated 
by  the  standard  error  of  measurement,  or  its  mathematical  function,  the 
probable  error  of  measurement.  Reliability  correlation  coefficients  for 
different  scales,  tests,  or  instruments  are  directly  comparable.  A 
probable  error  of  measurement  statistic  is  applicable  only  to  the  instrument 
on  which  it  was  developed. 

Table. 1 summarises  data  related  to  the  accuracy  or  stability  of  the 
seventeen  scores  reported  to  cadets.  The  reliability  coefficients  are 
Spearman-Brown  Formula  estimates  of  test-retest  correlation  coefficients. 


,!  based  on  the  median  reliability  coefficient  of  the  components  scales  (as 

reported  in  the  test  manuals)  and  on  the  number  of  components.  That 
these  are  useful  estimates  of  correlations  that  would  be  obtained  if  the 
tests  were  given  twice  without  extraneous  effects  was  indicated  by 
comparing  the  reliability  coefficients  yielded  by  this  formula  with 
those  produced  by  more  sophisticated  techniques  that  require  data  not 
available  for  the  component  scales  (Werts,  et  al,  1978). 

Normally  it  is  desirable  that  such  reproducibility  (reliability) 
coefficients  be  above  .90  for  measures  who  results  are  to  be  used  in 
making  decisions  on  individuals.  The  scores  reported  to  cadets  all  seem 
to  meet  this  standard. 

A more  meaningful  statistic,  when  interpreting  the  precision  of  a 
cadet's  score,  is  the  Probable  Error  of  Measurement  also  shown  in  Table 

1.  If  a test  could  be  given  an  infinite  number  of  times  to  the  same 
cadet  without  extraneous  effects,  his  mean  score  would  be  considered  his 
"true"  score  and  the  probable  deviation*  of  their  distribution  would  be 
the  Probable  Error  of  Measurement.  A cadet's  "true"  score  would  be 
within  one  PEMea8  of  his  obtained  score  50%  of  the  time.  The  chances 
are  90  in  100  that  his  obtained  score  is  not  more  than  2.439  PEM-as 
from  his  "true"  score.  There  are  about  5 chances  in  100  that  his  * true" 
score  is  more  than  2.439  PEueas  above  his  obtained  compatibility 
standard  score  or  predicted  Area  QPA. 

2.  Reliability  of  Differences  Between  Two  Area  Predicted  QPA's. 

Table  2 summarizes  the  data  related  to  the  magnitude  of  difference 
between  two  predicted  area  QPA's  for  a cadet  that  is  necessary  before 
one  can  have  confidence  that  the  difference  accurately  represents  the 
difference  between  his  two  corresponding  "true"  PQPA  scores  (as 
defined  in  previous  section).  As  is  usual  for  test  score  differences, 
the  reliability  coefficients  themselves  for  the  differences  certainly 
are  not  very  high.  This  makes  even  more  important  the  use  of  the 
Probable  Error  of  Measurement  of  the  differences  when  comparing  two 
predicted  Area  QPA's.  As  a rule  of  thumb,  when  the  difference  is 
less  than  the  Probable  Error  of  Measurement  of  the  difference  scores, 
no  confidence  can  be  held  that  they  reflect  true  differences  in 
the  cadet's  probable  success  if  he  were  to  chose  either  area.  When 
the  difference  between  two  area  PQPA's  is  greater  than  the  PEMea„, 
there  is  less  than  1 chance  in  4 that  the  direction  of  the 
“true"  differences  would  be  reversed.  If  the  differences  in  PQPA's 
for  any  two  areas  is  greater  than  the  figure  shown  within  paren- 
theses for  that  pair  of  area  PQPA's,  then  there  are  less  than  five 
chances  in  100  that  the  cadet  would  earn  a higher  area  QPA  in  the 
area  with  the  lower  PQPA,  unless  of  course  he  significantly  changes  in 
interests,  values,  motivations,  or  work-study  habits.  Thus  if  a 
cadet's  NPQPA  is  higher  than  his  BPOPA  by  0.06  points,  there  is  less  than 
1 chance  in  4 that  he  would  earn  a higher  area  QPA  in  the  Basic 
Sciences  Area.  When  this  difference  is  greater  than  0.14,  there 
is  less  than  1 chance  in  20  of  a reversal. 

Table  2 also  shows  the  number  of  cadets  and  the  means  for  all  the 
cadets  in  the  Class  of  1978  with  data  on  record  for  all  components  of 
the  given  area  PQPA  as  an  aid  in  understanding  and  explaining  the 
differences  between  the  probable  success  indications  for  a cadet.  It 
also  emphasizes  the  care  that  must  be  excercised  when  explaining  the 
differences  in  success  relative  to  other  cadets  in  the  given  areas,  (as 


*PD  - 0.67449  times  SD 
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reflected  by  area  standard  scores  and  by  the  corresponding  area  percen- 
tile ranks)  versus  differences  between  area  QPA's  themselves.  Briefly, 
the  means  of  the  predicted  raw  scores  indicate  that  if  all  cadets  in  the 
class  had  entered  any  one  of  the  areas,  their  expected  mean  area  QPA's 
would  differ  relatively  little.  However,  the  standard  scores  (SS) 
for  a given  area  are  scaled  so  that  all  cadets  actually  in  an  area  will 
have  a mean  SS  of  50  and  a standard  deviation  of  10,  and  can”be  directly 
converted  to  corresponding  area  percentiles.  Thus  a theoretical  "typical" 
or  average  cadet,  one  representative  of  the  entire  class,  would  do  much 
better  relative  to  others  in  the  same  area , if  he  were  to  choose  NSPA. 

He  would  be  poorest,  relative  to  others  in  the  same  area,  if  he  were  to 
choose  the  Basic  Sciences  Area. 

3.  Reliability  of  the  Differences  Between  Two  Area  Compatibility 
Standard  Scores. 

Table  3 presents  data  related  to  the  confidence  that  can  be  held  in 
the  significance  of  obtained  differences  between  two  Area  Compatibility 
Standard  Scores  of  the  same  type.  These  data  and  their  interpretation 
are  similar  to  those  discussed  above  for  differences  between  Predicted 
Area  QPA.  Thus,  if  a cadet's  compatibility  standard  score  derived  from 
the  SCI!  General  Interest  Scales  for  the  NSPA  area  (NGISS)  is  more  than 
1.61  standard  score  points  higher  than  his  comprable  score  for  the  Basic 
Sciences  Area  (BGISS) , there  is  one  chance  in  four  that  it  is  higher  due 
solely  to  errors  in  the  measurements  of  the  General  Interest  scales 
involved  in  these  two  area  compatibility  standard  scores.  In  other 
words,  some  confidence  can  be  held  that  this  cadet's  pattern  on  area 
discriminating  General  Interests  is  more  similar  to  the  mean  pattern  of 
graduating  in  the  top  half  of  the  NSPA  area  than  it  is  like  the  patterns 
of  above  average  cadets  in  the  Basic  Sciences  area  of  concentration. 
Doubling  this  1.61  PEueas  of  differences  gives  3.22  standard  score 
points.  When  a cadetss  NGISS  is  3.22  greater  than  his  BGISS,  there  is 
less  than  once  chance  in  eleven*  that  his  NGISS  "true"  score  is  equal 
to  or  less  than  his  BGISS  "true"  score. 

4.  Correlates  and  Validity  of  the  Area  Predicted  QPA's. 

Tables  4 and  5 present  data  related  to  interpreting  the  construct 
and  concurrent  validity  of  the  four  predicted  area  QPA's.  All  these 
correlations  are  based  upon  the  total  group  in  the  Class  of  1978  with 
data  on  the  pair  of  variables  involved,  not  upon  the  samples  used  in 
developing  the  score  equations.  (When  rounded  to  hundredths,  the 
correlations  involving  predicted  QPA  standard  scores — PQPASS's — are 
identical  with  the  comparable  correlations  involving  predicted  QPA's — 
i.e.  PQPA  "raw  scores.") 

(a)  Correlates  of  APQPA'b. 

The  underscored  correlations  in  the  left  section  of  Table  4 indicate 
that  each  of  the  PQPA's  has  an  exceptionally  high  correlation  with  its 
corresponding  earned  area  QPA.  Inspection  of  the  four  columns  shows 
that  the  best  predictor  of  each  area  QPA  is  its  corresponding  PQPA,  the 
underscored  correlation.  Interestingly  enough,  both  the  APQPASS  and  the 
NPQPASS  uniquely  have  a slightly  higher  correlation  with  the  earned 


*More  precisely,  p < 0.0885,  one-tailed  test. 


Basic  Sciences  QPA  (BQPA)  than  they  did  with  their  own  area  QPA's. 

Since  the  PQPA  score  development  groups  for  both  the  Basic  Sciences  and 
the  Humanities  areas  were  quite  small,  lower  reliability  for  these  two 
groups  per  se  does  not  seem  to  be  the  direct  cause.  Further  sharpening 
of  the  equations  in  the  future  may  throw  some  light  on  this  point. 

The  original  Physical  Science  Standard  Score  (PHYSCSS)  was  developed 
solely  to  optimize  differentiation  between  graduation  in  the  A/B  versus 
the  N/H  areas.  The  correlation  of  scores  on  this  scale  with  each  of  the 
four  area  QPA's  was  positive,  but  it  would  be  considered  a good  predictor 
only  of  AQPA  and  BQPA.  On  the  reports  to  cadets,  in  general,  the  further 
a cadet's  arrow  is  toward  the  left,  i.e.  toward  the  extreme  A/B  end  of 
the  composite  score  scale,  the  higher  the  expected  area  QPA  at  graduation. 
However,  this  does  not  seem  to  hold  true  for  QPA's  expected  in  the  NSPA 
and  the  Humanities  areas. 

The  middle  section  of  Table  4 provides  a meaningful  demonstration 
of  the  general  soundness  of  the  corrections  used  for  the  point-biserial 
correlation  (i.e.  the  two-group  membership  correlation)  by  the  maximum 
point-biserial  correlation  normally  possible  for  two  groups  containing 
the  observed  proportion  of  the  sample  involved.  In  general  the  corrected 
correlations,  those  shown  within  parenthesis,  are  in  the  same  general 
order  as  the  corresponding  regular  linear  correlations  with  QPA,  as 
shown  in  the  left-hand  section. 

The  correlations  given  in  the  right-hand  section  of  Table  4 indicate 
that  in  general,  for  the  Class  of  1978,  the  expected  level  of  success  on 
an  area's  specific  courses  (i.e.  the  area  PQPA)  is  only  a moderately 
good  predictor  that  a cadet  in  this  class  entered  and  graduated  in  the 
given  area.  It  is  hoped  that  the  guidance  program  for  which  these 
materials  were  developed  will  help  improve  this  situation  for  the  Class 
of  1981  and  for  subsequent  classes. 

(b)  Area  QPA's  versus  Area  Predicted  QPA's. 

Table  5 shows  the  actual  area  QPA's  earned  by  cadets  in  that  area 
with  a given  area  predicted  QPA  (area  PQPA).  Note  that  the  QPA's  and 
PQPA' s were  both  multiplied  by  100  for  computer  processing.  Merely  move 
this  decimal  point  two  places  to  the  left  to  convert  it  to  the  USMA 
scale.  (These  four  graphs  were  produced  by  the  SPSS  computer  statistical 
package.)  The  five  lines  drawn  on  each  represent  the  mathematically 
smoothed  general  linear  trend  based  on  the  data  for  the  group  in  that 
area.  The  heavy  central  line  is  the  regression  line,  indicating  the 
mean  area  QPA  earned  by  cadets  with  a given  PQPA.  Half  of  the  cadets 
normally  would  be  expected  to  earn  an  area  QPA  above  it;  half  below  it. 

The  dash  lines  indicate  the  trends  for  the  PQPA  plus  one  probable 
error  of  estimate  and  for  the  PQPA  minus  one  probable  error  of  estimate. 
Normally,  50%  of  a class  would  be  expected  to  fall  between  these  two 
dash  lines,  about  half  of  these  (25%  of  total)  should  fall  between  the 
upper  dotted  line  and  the  solid  line  (i.e.  in  the  "level  3 hi"  band). 

The  upper  of  the  two  lighter  solid  lines  indicates  the  trends  for 
2.439  multiplied  by  the  PE  t and  added  to  the  PQPA;  the  lower  indicates 
the  trend  for  2.439  multiplied  by  the  PE_st  and  subtracted  from  the 
PQPA.  As  shown  on  the  table,  normally  5%  of  a class  would  be  expected 
to  earn  an  actual  area  QPA  in  level  1,  (above  the  top  light  line)  and 
another  5%  in  level  5,  (below  the  bottom  light  line).  Successively 
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cumulating  the  percentages  from  the  top  down,  yields  the  percentage 
probabilities  reported  on  Chart  1 — probability  that  a cadet  with  a 
given  area  PQPA  will  actually  earn  an  area  QPA  surpassing  that  corresponding 
to  the  lower  limits  for  the  successive  levels.  For  example,  if  a 
cadet  has  an  APQPA  of  2.622,  there  are  about  5 chances  in  100  that 
his  earned  AQPA  at  graduation  would  be  3.075  or  more  (in  level  1);  25 
chances  in  100  that  it  will  exceed  2.808,  50  chances  in  100  that  it 
will  exceed  2.622  and  75  chances  in  100  that  it  will  exceed  2.436. 


1 


Finally,  there  are  95  chances  in  100  that  it  will  exceed  2.169  (level 
4 or  higher) . Hence,  there  are  five  chances  in  100  that  his  AQPA  at 
graduation  will  be  in  level  5.  The  magnitude  and  direction  of  the 
departure  of  a cadet's  earned  area  QPA  at  graduation  from  his  area 
PQPA  represents  the  magnitude  both  (1)  of  grade  relevant  motivations 
and  other  characteristics  that  currently  are  not  adequately  represented 
in  this  area  PQPA  equation  and  (2)  of  errors  of  measurement  included 
in  QPA  and  in  PQPA. 


The  lines  on  Table  3 show  the  general  trends  of  PQPA  levels  and 
bands  reported  on  the  two  computer  print-outs  for  each  cadet  (see 
Charts  1 and  2) . Table  3 also  shows  the  percentage  of  cadets  in  their 
area  with  an  area  QPA  at  graduation  that  did  not  exceed  selected 
values,  i.e.  the  four  area  percentile  ranks.  The  close  similarity  of 
the  PQPA* s data  for  the  Class  of  1978  and  the  preliminary  data  for  the 
Class  of  1979  indicates  that  these  tables  based  on  the  Class  of  1978 
data  continue  to  be  appropriate. 

5.  Correlations  of  the  Area  Compatibility  Scores  with  the  Criterion 
in  the  Developmental  Sample. 

Table  6 presents  data  on  the  concurrent  validity  in  the  group  on 
which  the  scales  were  developed  for  the  twelve  area  compatibility 
scales.  The  multiple  correlation  between  an  optimal  combination  of 
selected  compatibility  scales  and  being  in  the  given  area  is  shown  at 
the  right  end  of  the  raw  for  each  area  of  concentration. 

(Note:  In  a multiple  regression  correlation,  several  independent 
factors  (in  this  case  the  twelve  compatibility  scores)  are  weighted 
statistically  in  terms  of  their  combined  importance  as  a mean  of 
explaining  the  differences  in  the  dependent  variable  (in  this  case 
graduation  in  the  given  area  of  concentration  versus  in  any  of  the 
other  areas  of  concentration.)  When  these  equations  were  applied  to 
the  total  Class  of  1978  and  to  the  Class  of  1979  for  which  requisite 
data  were  available,  the  corrected  multiple  correlations  were  as 
follows: 


Applied  Science 
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The  magnitudes  of  the  underscored  correlations  indicate  that  most 
of  these  compatibility  scores  are  considered  to  have  a good  co-relationship 
with  being  in  the  corresponding  area  of  concentration.  For  example, 
nine  of  these  twelve  are  within,  or  above,  the  usual  range  of  correlations 
found  for  both  public  school  pupils  and  college  student's  between 
their  mental  ability  test  scores  and  their  average  academic  marks. 

Even  with  normally  expected  shrinkage  when  the  Class  of  1978 
equations  are  used  to  develop  area  compatibility  scores  for  other 
classes,  an  individual  compatibility  Bcore  should  have  adequate  validity 


to  provide  useful  guidance.  Furthermore,  a cadet's  pattern  on  all 
twelve  compatability  scores  should  retain  excellent  validity  as  a guide 
in  identifying  the  area(s)  of  concentration  with  which  his  profile  of 
interests  and  values  are  most  similar  and  the  area(s)  with  which  his 
profile  is  least  similar.  In  general  the  relatively  lower  ones  of  the 
correlations  for  the  area  compatibility  scores  are  judged  to  result 
largely  from  the  smaller  number  of  value  scores  selected  for  inclusion 
and  their  lower  reliability  coefficients  or  from  the  very  small  number 
in  two  of  the  area  developmental  groups.  Data  on  other  and  larger 
samples  should  throw  more  light  on  the  validity  of  all  of  the  compatibility 
scores. 

6.  The  Validity  and  Cross-Validity  of  17  Scores  to  be  Reported  to 
Cadets . 

The  concurrent  validity  of  the  seventeen  scoring  equations 
developed  on  a sample  from  the  Class  of  1978  is  indicated  by  their 
application  to  all  of  the  cadets  in  the  Class  of  1978.  In  general,  the 
validity  of  all  of  them  in  measuring  what  they  were  designed  to  measure 
is  clearly  demonstrated  by  the  data  from  the  scores  to  the  cadets  in 
the  Class  of  1979.  These  data  are  summarized  in  Table  7.  Clearly,  in 
most  cases  there  has  been  an  unusually  small  shrinkage  in  the  validity 
coefficients . 

7.  Evaluation  of  the  Proposed  Guidance  Program. 

The  validity  of  the  scores  themselves  has  been  demonstrated  on 
two  classes.  Although  both  validity  and  cross-validity  were  exceptionally 
high,  possibilities  for  refinements  and  improvements  were  indicated. 

In  their  present  form  the  scores  clearly  identify,  with  a high  degree 
of  accuracy,  the  area(s)  of  academic  concentration  in  which  a cadet  is 
likely  to  be  most  satisfied  and  successful.  Thus,  one  might  say  that 
the  quality  of  the  contents  has  been  evaluated,  but  the  packaging, 
delivery  and  consumption  remains  to  be  evaluated.  Specifically,  the 
effectiveness  with  which  the  scores  are  reported  to  cadets  and  of  the 
guidance  program  accompanying  them  warrant  evaluation.  It  may  be  found 
that  somewhat  more  extensive  preparation  of  the  cadets  in  the  use  of 
the  scores  and  in  the  decision  making  process  itself,  or  more  access  to 
a professionally  trained  guidance  counselor  (individually  or  in  groups) 
or  additional  preparation  of  the  company  academy  counselors  in  the 
interpretation  and  use  of  the  scores  will  be  found  desirable  to  obtain 
such  possible  outcomes  of  the  program  as  the  following: 

— A larger  proportion  of  the  graduating  class  highly  satisfied 
with  their  choice,  and  a smaller  proportion  dissatisfied. 

— A reduction  in  the  proportion  of  the  class  that  seeks  to  change 
their  initially  chosen  area  of  concentration. 

— A larger  proportion  of  the  graduating  class  that  ranks  their 
area  first  when  asked  to  rank  the  areas  in  the  order  of  the  extent  to 
which  they  would  find  them  personally  satisfying. 

— A reduction  in  the  proportion  of  the  cadets  in  each  area  with 
very  low  compatibility  scores. 

— An  increase  in  the  average  compatibility  score  and  predicted 
area  QPA  in  each  area. 

— A significant  shift  toward  positive  skewness  and  perhaps  leptokurtos 
(peakedness)  in  the  shape  of  the  distributions  of  final  area  QPA's, 
predicted  QPA's,  and  compatibility  scores. 
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— Increased  general  satisfaction  with  relevant  important  specifics 
in  the  USMA  academic  program. 

— Reduction  in  the  proportion  of  the  cadets  in  each  area  of  concentration 
whose  area  QPA  is  significantly  below  that  predicted  (sometimes  called 
"under  achievement"). 

— Increase  in  the  proportion  of  cadets  whose  area  QPA  is  significantly 
above  that  predicted. 

D.  CONCLUSIONS 


1.  The  results  may  be  used  by  cadets,  but  only  as  a guide,  since 
their  decision  on  area  of  concentration  should  include  any  other  relevant 
considerations  that  are  important  to  them  and  to  their  goals  in  life. 

2.  For  some  cadets,  these  measures  currently  will  not  provide 
significant  discrimination  between  the  areas  they  are  seriously  considering. 

3.  Although  application  to  the  Class  of  1979  data  available  near 
the  end  of  their  seventh  term  indicates  exceptionally  high  overall  cross 
validity,  some  of  the  components  involved  in  the  compatibility  scores 
need  to  be  refined  and  sharpened  up.  Research  efforts  to  improve  the 
techniques  for  computing  and  using  the  scores  should  accompany  the 
validation  research  when  the  final  Class  of  1979  criterion  data  are 
available.  (This  class  took  the  SCII  in  September  1978.) 

4.  At  each  step  in  the  implementation  of  this  program  every  possible 
effort  should  be  made  to  identify  and  counteract  the  inherent  dangers  in 
such  a system,  such  as  a tendency  for  some  to  be  overly  dependent  on  it, 
lack  of  complete  accuracy  in  the  measures,  insufficient  discrimination, 
and  cadets  becoming  confused  by  the  many  complications,  and  considerations. 

5.  The  sustained  cross  validity  of  the  program  for  the  areas  in 
which  the  scoring  equations  were  developed  on  small  samples  suggests  it 
may  be  possible  to  develop  a similar  program  for  guidance  in  choice  of 
field  of  study. 


E.  RECOMMENDATIONS 


1.  Administer  the  SCII  test  to  the  Class  of  1981;  compute  the 
special  area  scores;  and,  prior  to  selection  of  an  area  of  concentration 
give  these  cadets  a simplified  computer-produced  summary  similar  to 
Chart  2. 


2.  Provide  the  Company  Academic  Counselors  a more  refined  form, 
using  a computer-produced  format  along  the  lines  of  that  shown  in  Chart 


3.  Prior  to  giving  the  Company  Academic  Counselors  the  cadet's 
reports  (Chart  1) , provide  the  counselors  with  written  and  oral  explanations 
of  the  basis,  meaning,  interpretation,  and  use  of  the  results,  with 
instructions  by  the  Office  of  the  Dean. 


4.  Obtain  feedback  from  the  cadets  to  assist  in  refining  the  system 

5.  Evaluate  the  system  over  the  next  ten  months  to  determine  if  it 
is  in  fact  a useful  counseling  tool.  Incorporate  necessary  changes  to 


th#  (yttM  during  the  (vduttlon  to  account  for  changes  in  the  character- 
istics of  its  criterion  groups  and  improvements  in  the  methodology. 

6.  Based  on  the  results  obtained  from  Recommendation  5,  decide  on 
whether  or  not  to  continue  the  system  with  the  Class  of  1982,  by  October 
1979.  ' 
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Table  2 


Intercorrelations  and  Reliability  of  Differences  Between 
Area  Predicted  QPA's 

(The 'intercorrelations  are  above  the  diagonal  and  reliability 
coefficients*  are  below  the  diagonal  of  section  A) 


APQPA 


BPQPA 


NPQPA 


HPQPA 


BPQPASS 


NPQPASS 


HPQPASS 


Mean  SS 
SD  SS 
Mean 
Raw  Sc. 
SDR  Sc. 


(The  standard  deviations  of  differences  in  Area  PQPA  Raw  Score  are 
above  the  diagonal  and  the  Probable  Error  of  Measurements  of 
Differences  (t  difference  for  9/10  confidence)  are  below  the 
diagonal  of  Section  B) 


APQPA 

BPQPA 


NPQPA 


HPQPA 


*The  proportion  of  the  variance  in  the  differences  between  cadet's 
pair  of  obtained  scores  (SD2l-2)  that  is  due  to  variance  in 
differences  between  cadet's  "true"  scores  on  the  measures  (SD2 
True  Diff.).  (Bridges  1979.) 
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Maximum  Possible 

rpt.  bis.  .80  .80  .80  .79  Max  rpt.bis  .77  .58  .785  .615 


I QPA’*  Earned  tr.  Class  of  1978  by  Cadets  with  Lach  Area  Predicted  QPA  (PQPA)  for  the  Given 
Corresponding  to  Selected  Earned  Area  QPA’s,  and  Pelevant  Statistics.  (All  QPA  Data  Have 


167. (,0  195.00  273.03  751.00  779. 0C  507.00  535.00  343.00  391.00  *19.00  **7.00 

STATISTICS:  Correlation  (r)“0.8626  Probable  Error  of  Estimate  - 18.58  AQPA  * 1.01927  AQPA  -6.70273  So.  Plotted  Value* 
Hear.  AQPA  - 313.5  SO  AQPA  - 45.58  TOTAL  A PEA  G«VP : So.  - 223  Kean  AQPA  - 310.2  SO  AQPA  « 58.80 


STATISTICS:  Correlation  <r)«0.8678  Probable  Error  of  Estimate  - 17.72  NQPA  » 0.98896  NPQPA  *3. 17268  No.  Plotted  Values 
149  Mean  NQPA  » 273.29  SD  NQPA  * 46.24  TOTAL  AREA  GROUP:  No.  - 333  Mean  NQPA  « 278.0  SD  NQPA  - 57.55 


Probable  Error  of  Eatlnate  - 12.00  HQPA  ■ 0.98626 
9 TOTAL  AREA  GROUP:  So.  - 93  Mean  HQPA  • 321.5 


Correlations  of  12  Area  Coaipatibility  Standard  Scores 
Kith  Membership  (1) /Nonmembership  (0)  in  Area  Groups  at  Graduation* 
IN-Sample  of  171  in  Class  of  1978  remaining  in  the  Final  Developmental  Analyses 
Hence  With  Complete  Data  on  All  Successively  Considered  Variables.) 
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Table  7 


The  Validity  and  Cross  Validity  of  the  Seventeen  Scores 


Correlations  Between  Each  Set  of  Scores  and  Their  Criterion 
For  All  Cadets  Having  Data  on  the  Corresponding  Pair  of  Variables 
In  the  Total  Class  of  1978  (Maximum  N - 733)  and  in  the  Class  of  1979 
(Maximum  N - 741).  For  the  Dichotomus  Dummy  Variables,  the  Obtained 
Point  Biserial  Correlations  Have  Been  Corrected  to  Same  Base. 


Total  Class 

I Class  of  of 

1978  1979 


SCORES 

N 

rpt.  bis. 

r. 

N 

rpt.  bis. 

r . 

COMPOSITE  A/B-N/H 

255 

(.674) 

.853 

307 

(.652) 

.826 

PREDICTED  AREA  QPA's 

APQPA 

115 

(-) 

.800 

187 

(-) 

.823 

BPQPA 

51 

(-) 

.933 

31 

(-) 

.922 

NPQPA 

149 

(-) 

.866 

161 

(-) 

.884 

HPQPA 

37 

(-) 

.916 

24 

(-) 

.862 

♦ 


AREA  COMPATIBILITY 
STANDARD  SCORES 
SIMILARITY  OF  GENERAL 
INTERESTS 


AGISS 

639 

(.5274) 

.685 

688 

(.4792) 

.614 

BGISS 

632 

(.3744) 

.646 

656 

(.1298) 

.282 

NGISS 

639 

(.5256) 

.528 

658 

(.4675) 

.592 

HGISS 

706 

(.3038) 

.494 

755 

(.1832) 

.331 

SIMILARITY  OF 

OCCUPATIONAL  INTERESTS 

AOISS 

563 

(.4983) 

.647 

580 

(.5633) 

.722 

aoiss 

582 

(.3182) 

.549 

588 

(.1815) 

.395- 

NOISS 

565 

(.5050) 

.643 

587 

(.5552) 

.703 

HOISS 

604 

(.2708) 

.440 

618 

(.1534) 

.279 

SIMILARITY  OF  ROKEACH 

VALUES 

ARVSS 

589 

(.2505) 

.325 

559 

(.0377) 

.048 

BRVSS 

589 

(.2581) 

.445 

559 

(.0358) 

.079 

NRVSS 

589 

(.2177) 

.277 

559 

(.1040) 

.132 

HRVSS 

589 

(.1718) 

.279 

559 

(-.0043) 

-.008 

CHART  2 - SAMPLE  OF  SUMMARY  SHEET  TO  BE  SENT  TO  CADETS 


WILLIAMS,  JOSEPH  K 


8119437 


Co.  B4 


SECTION  I:  COMPATIBILITY  (SIMILARITY  OF  INTERESTS  8 VALUES) 

MOST  APPLIED  SCIENCES  AND  ENGINEERING 

2ND  BASIC  SCIENCES 

3RD  NATIONAL  SECURITY  AND  PUBLIC  AFFAIRS 

LEAST  HUMANITIES 


SECTION  II:  PREDICTED  AREA  QPA 


RANGE 


APPLIED  SCIENCES  AND  ENGINEERING 
BASIC  SCIENCES 

NATIONAL  SECURITY  AND  PUBLIC  AFFAIRS 
HUMANITIES 


Probable 

Low 

3. SO 
3.36 
3.46 
2.65 


Probable 

High 

3.88 
3.60 
3.82 

2.89 


SECTION  III:  B/A  AREAS  GROUP  VS  N/H  AREAS  GROUP 

THE  COMPOSITE  OF  YOUR  COMPATIBILITY  8 SUCCESS  PUCES  YOU  AS  FOLLOWS: 


"B/A"  Areas 

VERY  TYPICAL 

HIGH  HIGH  AREAS 

B/A  B/A  B/A 

I 1 I I I 


E 

I 

T 

H 

E 

R 


"H/N"  Areas 

TYPICAL  VERY 

AREAS  HIGH  HIGH 

H/N  H/N  H/N 


.1. 

t 


.1. 


■ I. 
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APPENDIX  I 


Data  for  the  Strong  Campbell  Interest  Inventory  (SCII)  Scores  Used  In 
Developing  the  Area  General  Interest  Pattern  Scales. 

Selected  data  on  the  SCII  Scales  used  to  compute  the  four  area  similarity 
satisfaction  standard  scores  (area  GISS)  and  the  four  area  specific 
QPA  Raw  Scores  (area  QGIRSC) . 


Academic  Area  of  Concentration. 

Applied  Science  and  Engineering  Area. 

Basic  Science  Area. 

National  Security  and  Public  Affairs  Area. 
Humanities  Area. 

Correlation  with  area  group  membership. 
Point  Biserial  correlation  coefficients, 
with  cadets  in  the  given  area  having  a 
score  of  "1"  and  cadets  in  other  areas  a 
score  of  "0".  An  underestimate  of  the 
usual  linear  correlation  coefficient. 

The  maximums  normally  possible  are  about 
.78  for  areas  "A"  and  "N",  and  .60  for 
areas  "B"  and  "H". 


Usual  linear  correlation  of  variable  with 
indicated  area  QPA?  the  Pearson  product- 
moment  coefficient. 

Standard  deviation. 

Standard  error  of  mean,  SD  of  means  of 
random  samples  of  same  size  from  population. 


(1)  A positive  correlation  indicates  that  high  Bcores  on  that  interest 
scale  are  directly  associated  with  high  scores  on  the  criterion 
(Group  membership  or  QPA) . A reported  negative  correlation  indicates 
that  low  scores  on  that  interest  scale  are  significantly  associated 
with  high  scores  on  the  criterion. 

(2)  Correlations  within  parentheses  were  not  included  in  developing 
the  computed  scores.  They  are  reported  only  for  completeness. 

(3)  Most  of  the  correlation  coefficients  used,  those  not  within 
parentheses,  are  significant  at  an  alpha  level  better  than  .001  for 
the  two  areas  with  the  largest  number  of  cadets  (area  A fc  N) . For  the 
"B"  and  "H"  areas  r's  with  lower  obtained  significance  levels  are 
included  in  the  computed  score  keys. 

(4)  The  number  of  cases  on  which  the  statistics  in  a given  column  are 
based  is  indicated  in  parentheses  under  the  heading. 


Abbreviations: 


Area 


B 

N 

H 

r 

pt.  bis. 


r 

_2_ 

SD 

SE 

M 


Explanations: 
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APPENDIX  II 


Data  for  the  Strong  Campbell  Interest  Inventory  (SCII)  Scores  Used  In 
Developing  the  Area  Occupational  Interest  Pattern  Scales. 

Selected  data  on  the  SCII  Occupational  Interest  Scales  used  to  compute 
the  four  area  similarity  satisfaction  standard  scores  (area  OISS)  and 
the  four  area  specific  QPA  Raw  Scores  (area  QOIRSC) . 

Explanations; 

(1)  A positive  correlation  indicates  that  high  scores  on  that  interest 
scale  are  directly  associated  with  high  scores  on  the  criterion  (group 
membership  or  QPA) . a neqative  correlation  indicates  that  low 

scores  on  that  interest  scale  are  significantly 'associated  with  high 
scores  on  the  criterion. 

(2)  Correlations  within  parentheses  were  not  included  in  developing 
the  computed  scores.  They  are  reported  only  for  completeness. 

(3)  Most  of  the  correlation  coefficients  not  within  parentheses  are 
significant  at  an  alpha  level  better  than  .001  for  the  two  areas  with 
the  largest  number  of  cadets  (areas  A 6 N) . For  the  "B"  and  "H"  areas 
some  r's  with  lower  obtained  significance  levels  are  included  in  the 
computed  score  keys. 

(4)  The  number  of  cases  on  which  the  statistics  in  a given  column  are 
based  is  indicated  in  parentheses  under  the  heading. 

Abbreviations : 


Area 

A 

B 

N 

H 

rpt.  bis. 


fa 

SD 


Academic  Area  of  Concentration. 

Applied  Science  and  Engineering  Area. 

Basic  Science  Area. 

National  Security  and  Public  Affairs  Area. 

Humanities  Area. 

Correlation  with  area  group  membership.  Point 
biserial  correlation  coefficients,  with  cadets  in 
the  given  area  having  a score  of  "1"  and  cadets 
in  other  areas  a score  of  "0".  A minimal  estimate 
of  the  usual  linear  correlation  coefficient.  The 
maximums  normally  are  about  .78  for  areas  "A  & N", 
and  about  .60  for  areas  "B  & H". 

Usual  linear  correlation  of  variable  with  in- 
dicated area  QPA,  a Pearson  product-moment  coefficient. 
Standard  Deviation. 


SE  Standard  error  of  mean,  SD  of  means  of  random 

M samples  of  same  size  from  population. 
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APPENDIX  III 

Data  for  Rokaach  Value  Scales 

Selected  data  on  the  Rokeach  Values  (RV)  used  to  compute  the  four  area 
compatibility  standard  scores  (area  RVSS)  and  the  four  area  specific  QPA 
Standard  Scores  (area  ORVSS) . 

Explanations! 

(1)  Since  RV  raw  scores  are  from  rankings,  with  "1"  being  highest  in 
importance  and  "18"  being  lowest,  for  RV  raw  scores  NEGATIVE  correlation 
coefficients  indicate  that  cadets  in  the  area  (rpt.  bis.),  or  with  high 
area  QPA's  (rQ) , tended  to  rank  that  value  as  higher  in  importance  than 
did  other  cadets.  Correspondingly,  positive  r's  for  RV  scores  reflect 
inverse  relationships  between  the  perceived  importance  of  that  value  and 
the  criterion. 

(2)  Correlations  within  parentheses  were  not  included  in  developing 
the  computed  scores.  They  are  reported  only  for  completeness. 

(3)  Correlation  coefficients  not  within  parentheses  are  significant 
at  an  alpha  level  better  than  .01  for  the  two  areas  with  the  largest 
number  of  cadets  (areas  A & N) . For  the  "B"  and  "H"  areas  some  r's 

lower  obtained  significance  levels  are  included  in  the  computed  score 

keys . 

(4)  The  number  of  cases  on  which  the  statistics  in  a given  column  are  based 
is  indicated  in  parentheses  under  the  heading. 

Abbreviations: 


Academic  Area  of  Concentration. 

Applied  Science  and  Engineering  Area. 
Basic  Science  Area. 

National  Security  and  Public  Affairs  Area 
Humanities  Area. 


Correlation  with  area  group  membership. 

Point  Biserial  correlation  coefficients,  with 
cadets  in  the  given  area  having  a score  of  "1" 
and  cadets  in  other  areas  a score  of  "0".  A 
minimal  estimate  of  the  usual  linear  correlation 
^coefficient  (Pearson  product  - moment) . 

Usual  linear  correlation  of  variable  with  in- 
dicated area  QPA. 


Standard  Deviation 


Standard  error  of  mean,  SD  of  means  of  random 
samples  of  same  size  from  population. 


APPENDIX  III  Rokeach  Value  Basic  Data 
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APPENDIX  IV 


Data  on  Early  Academic  Performance  at  USMA  used  in  developing  Predicted 
Area  Success  Scales.  Selected  data  on  grades  earned  in  courses  that 
normally  will  be  completed  by  end  of  third  term;  averages  for  courses 
by  indicated  academic  department  or  group  of  departments. 

Explanations: 

(1)  A positive  correlation  indicates  that  high  grades  on  that  course 
are  directly  associated  with  high  scoreB  on  the  criterion  (group 
membership  or  QPA) . A reported  negative  correlation  indicates  that  low 
grades  on  that  course  are  significantly  associated  with  high  scores  on 
the  criterion. 

(2)  Correlations  within  parentheses  were  not  included  in  developing 
the  computed  scores.  They  are  reported  only  ior  completeness. 

(3)  Most  of  the  correlation  coefficients  used,  those  not  within 
parentheses,  are  significant  at  on  alpha  level  better  than  .001  for  the 
two  areas  with  the  largest  number  of  cadets  (areas  A & N) . For  the  "B" 
and  "H"  areas  some  r's  with  lower  obtained  significance  levels  are 
included  in  the  computed  score  Keys. 

(4)  The  courses  included  when  computing  a cadet's  departmental  average 
grade  are  underscored.  The  foreign  language  averages  also  included  LX 
141,  142,  151,  and  152. 

(5)  The  number  of  cases  on  which  each  rpt.  bis.  is  based  is  that  given 
in  the  Total  Class  N column. 

Abbreviations: 


Area 

A 

B 

N 

H 


rpt.  bis. 


fa 


SD 

§E 


M 


Academic  Area  of  Concentration. 

Applied  Science  and  Engineering  Area. 

Basic  Science  Area. 

National  Security  and  Public  Affairs  Area. 
Humanities  Area. 

Correlation  with  area  group  membership. 
Point  biserial  correlation  coefficients, 
with  cadets  in  the  given  area  having  a 
score  of  "1"  and  cadets  in  other  areas 
a score  of  "0".  An  under  estimate  of  the 
usual  linear  correlation  coefficient.  The 
maximums  normally  possible  are  about  . 78 
for  areas  "A"  and  "NM,  and  .60  for  areas 
"B"  and  "H". 

Usual  linear  correlation  of  variable  with 
indicated  area  QPA:  the  Pearson  product- 
moment  coefficient. 

Standard  deviation. 

Standard  error  of  mean,  SD  of  means  of 
random  samples  of  same  size  from 
population. 
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APPENDIX  IV  Data  on  Early  USMA  Academic  Performance 


•Except  for  the  three  English  course*  with  small  N's,  all  over-all  P’s  were  significant  well  beyond  the  .001  level. 
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APPENDIX  V 


Data  on  Relevant  Pre-USMA  Performance  ; selected  data  on  variables 
available  when  evaluating  candidates  for  admission  to  USMA. 


Explanations: 


(1)  Only  the  High  School  Rank  Score  is  available  currently  for 
almost  all  cadets  in  the  Classes  of  1978  and  1981,  and  this  is  the 
only  one  that  can  be  used  now. 

(2)  Three  experimental  computed  variables  were  developed  from 
the  three  groups  of  correlations  underscored  in  the  four  rQ 
columns  (respectively  College  Entrance  Examination  Boards  Tests, 
American  College  Testing  Program  Tests,  and  High  School  Academic 
Performance) . 


(3)  The  mean  and  standard  deviation  of  Area  QPA's  also  are 
presented  for  each  area  to  facilitate  relevant  comparisons  and 
interpretations . 


(4)  A positive  correlation  indicates  that  high  scores  on  that 
interest  scale are  directly  associated  with  high  scores  on  the 
criterion  (group  membership  or  QPA) . A reported  negative 
correlation  indicates  that  low  scores  on  that  interest  scale 
are  significantly  associated  with  high  scores  on  the  criterion. 

(5)  A majority  of  the  correlation  coefficients  are  significant 

at  an  alpha  level  better  than  .001,  even  for  the  "B"  and  "H"  areas 

(6)  The  number  of  cases  on  which  the  rpt.  bis.  statistics  are 
based  is  the  same  as  the  Total  Number  in  the  class  having  that 
measure,  as  given  in  the  last  column. 

Abbreviations : 


Academic  Area  of  Concentration. 

Applied  Science  and  Engineering  Area. 
Basic  Science  Area. 

National  Security  and  Public  Affairs  Area 
Humanities  Area. 


Correlation  with  area  group  membership.  Point 
biserial  correlation  coefficients,  with  cadets 
in  the  given  area  having  a score  of  "1"  and 
cadets  in  other  areas  a score  of  "0".  A 
minimal  estimate  of  the  usual  linear  correlation 
coefficient.  The  maximums  normally  are  about 
.78  for  areas  HA  & N",  and  about  .60  for  areas 
"B  6 H". 


APPENDIX  VI 


Percentage  diatributions  of  the  standard  scores  made  by  the  Class  of  1976 
cadets  in  each  area  of  concentration,  of  those  in  the  lower-half  of 
their  area  groups  on  their  Area  QPA,  and  those  in  the  four  upper-half 
groups.  Descriptive  statistics  are  included  for  the  largest  complete 
d*ta  samples  on  which  they  were  available  from  other  analysis. 

Distributions  are  shown  by  relative  level  in  the  scaling  population  in 
the  indicated  appendix  sections  for  following  standard  scores: 


Standard  Scores 

Appendix  Sections 

Page 

Physical  Science/Non-Physical  Science 
(B/A  - H/N  SS’s) 

A 

51 

Predicted  Area  QPA  (Area  PQPASS's) 

B-E 

52 

General  Interest  Area  Compatibility  (Area 
GISS's) 

F-I 

56 

Occupational  Interest  Area  Compatibility 
(Area  OISS's) 

J-M 

60 

Rokeach  Values  Area  Compatibility  (Area 
RVSS's) 

N-Q 

64 

! 

I 


50 


Appendix  VI -B 

Percentage  Distribution*  of  Predicted  Applied  Science 
Area  QPA  Standard  Scores  by  Actual  QPA  Group 


Appendix  VI -0 

Percentage  Distributions  of  Predicted  N8PA 


* 


Appendix  VI -J 

Percentage  Distribution  of  Area  Compatibility  Scores  by  QPA  Group: 


Appandix  VI  -O 

Farcantaga  Distribution  of  Aram  Compatibility  scoraa  by  QPA  Group i 
Rokaach  Valua  Standard  Scoraa 


■ 


APPENDIX  VIII 

DISCRIMINANT  ANALYSIS  STATISTICS 


The  parts  of  this  appendix  present  selected  statistics  from  discriminant 
analyses.  The  following  simplified  discussion  should  help  individuals 
with  at  least  some  degree  of  sophistication  in  mathematics  to  understand 
these  statistics. 

The  general  purpose  of  discriminant  analysis  is  to  select  a set  of 
possible  predictor  variables  (by  a process  similar  to  multiple  Regression) 
those  variables  that  contribute  significantly  to  classifying  the  members 
of  a set  of  criterion  groups  into  their  actual  groups.  The  specific 
mathematical  objective  is  to  weight  and  linearly  combine  the  discriminant 
analysis  forms  simultaneously  two  special  factor  analyses  (one  of  the 
predictor  variables  and  another  of  the  criterion  groups)  to  identify  the 
factors  in  the  criterion  group  that  are  predictable  by  corresponding  factors 
in  the  original  predictor  variables. 

The  maximum  possible  number  of  such  common  factors  (orthogonal  dimensions) 
is  one  less  than  the  number  of  dependent  criterion  groups.  The  association 
between  each  predictor  "factor  score"  from  a discriminate  function  (the 
sum  of  the  optimally  weighted  predictor  variables)  and  membership  in  one 
of  the  set  of  criterion  groups  is  called  canonical  correlation. 

The  discriminant  analysis  process  develops  a set  of  equations  (matrix)  for 
each  of  the  common  dimensions,  which  are  referred  to  as  discriminant 
functions.  Once  the  discriminant  function  equations  are  derived  for  the 
known  groups,  a set  of  classification  function  equations  can  be  derived 
which  will  permit  the  classification  of  new  cases  with  unknown  memberships. 

Since  each  such  function  is  a dimension,  the  mean  score  of  a group  on 
each  function  can  theoretically  be  plotted  in  n-dimensional  space  (with 
"n"  equal  to  the  number  of  such  functions)  as  a point  called  the  group 
centroid.  Similarly,  a function  score  can  be  computed  for  each  individual 
in  a given  group  and  "plotted"  likewise  in  dimensional  space.  The  n- 
dimensional  centroid  point  for  a group  represents  the  central  tendancy 
for  the  cluster  of  individual  group  member's  "points"  in  this  n-dimensional 
space. 

Individuals  whose  corresponding  points  in  space  are  closest  to  the  centroid 
point  for  their  group,  are  said  to  be  correctly  classified.  Those  whose 
corresponding  point  in  space  is  a greater  distance  from  their  own  group's 
centroid  than  from  the  centroid  of  another  group  are  "misclassified,"  since 
their  pattern  on  the  predictor  variables,  as  weighted  for  the  discriminant 
function,  is  more  like  the  pattern  for  another  group  than  for  their  own. 

The  closer  an  individual's  point  in  space  to  the  centroid  for  a group, 
the  more  similar  his  pattern  (weighted  profile)  is  to  the  correspondingly 
weighted  pattern  (on  the  selected  original  variables)  for  that  group. 

Note  that  this  is  not  necessarily  the  modal  or  most  typical  pattern. 

(It  is  the  pattern  of  means,  not  actually  the  mean  pattern.)  When  two 
discriminate  functions  (dimensions)  account  for  most  of  the  significant 
variance  (as  is  commonly  true  for  the  discriminate  analyses  of  area 
of  concentration  groups)  then,  a regular  two  axis  plot  meaningfully  depicts 
the  relationships. 

The  other  important  statistical  terms  in  the  tables  are  more  commonly 
used  statistics. 
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APPENDIX  IX 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 
» RECIPIENT'S  CATALOO  NUMSER 


00 VT  ACCESSION  NO. 


S.  TYNE  OF  REPORT  * PERIOD  COVERED 


Th*  Development  of  Guidance  Materials  for  Cadets 
in  the  Selection  of  Their  Area  of  Concentration 


Claude  F 


PERFORMINO  OROANt  Z ATION  NAME  AND  ADDRESS 

Office  of  the  Director  of  Institutional  Research 
United  States  Military  Academy 
West  Point,  New  York  10996 

CONTROLLINO  OFFICE  NAME  AND  ADDRESS 

Same  as  t9  Above. 


June  1979 


ix  ♦ 84 

IS.  SECURITY  CLASS,  (ml  MM«  i«WJ 


United  States  Military  Academy 
West  Point,  New  York  10996 


UNCLASSIFIED 

OCC^  »SSI  FIC  ATION'1  DO  WNORADINO 


Approved  for  public  release;  distribution  unlimited 


Statistical  Procedures 
Strong-Campbel 1 
Interest  Inventory 
Value  Systems 


Prediction 
Profiles 

Psychometric  Techniques 
Rokeach  Value  Survey 

Service  Academies 

|M.  ASSTRACT  PCMHwt  m ipyyt—  «*A  M mmmmmmmmr  mmd  Ipn NIQr  Fy  SI— A wli 

1 A guidance  program  and  techniques  to  assist  cadets  in  selecting  the 
area  of  concentration  most  compatible  with  their  profile  of  measured  interests 
values  and  academic  capabilities  were  developed  on  the  Class  of  1978  and 
cross-validated  by  application  to  the  Class  of  1979. 


Academic  Prediction 
College  Majors 
Educational  Guidance 
Interest  Patterns 


The  new  measures  of  compatibility  between  a cadet's  pattern  on  selected 
interests  and  values  and  the  pattern  of  cadets  typical  of  those  successful  in 


the  two  more  popular  areas  of  concentration  (the  Applied  Science  and  Engineerin' 
area  and  the  National  Security  and  Public  Affairs  area)  had  high  validity 
(respective  r's  - ■ 71  and  .67) , on  the  Class  of  1978  from  which  a sample  was 
used  to  develop  the  techniques  and  high  cross  validity  on  the  Class  of  1979 
(respective  r’s  - . 68  and  .65) Compatibility  scores  developed  for  both  the 
Basic  Sciences  and  Humanities  areas  were  based  on  samples  that  would  be 
completely  inadequate  in  size  if  the  traditional  techniques  were  used. 

However,  their  respective- validities  on  the  Class  of  1978  vers  .68  and  .64 
and  their  cross  validities  were  still  promising  ( . 34  and  . 31) , but  indicated 
that  further  refinement  is  necessary. 


The  four  area  Predicted  Quality  Point  Averages  had  exceptionally  high 
validities  and  cross  validities  ranging  from  . 86  to  .93  for  the  Class  of 
1978  and  cross  validities  of  . 79  to  ■ 92  when  applied  to  the  Class  of  1979 


A Physical  Science  Areas/Non-Physical  Science  Areas  Score  (A,B/N,H)  had  a 
correlation  of  .90  for  the  developmental  sample,  .85  for  the  total  Class  of 
1978  and  .83  for  the  Class  of  1979. J 


Such  cons i s ten c.ly  high  validities  indicate  high  potential  for  improving  the 
matching  of  a cadet's  special  characteristics  with  his  area  of  concentration 
and  increasing  his  satisfaction  and  success  at  West  Point. 


A new  statistic  is  presented  that  indicates  the  reliability  of  differences 
between  scores  on  two  scales,  based  on  the  correlation  between  the  two  and 
on  their  two  reliability  coefficients.  A 


Further  developments  will  follow  trial  «se  of  the  techniques  to  help  guide 
the  Class  of  1981  Cadets  in  choosing  their  area  of  academic  concentration. 
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